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SECTION I 

STUDIES OP MINIMAL ESSENTIALS IN 
ELEMENTAEY SCSHOOL SUBJECTS 

CHAPTER I 

SOME SOCIAL DEMANDS ON THE COURSE 
OP STUDY IN AEITHMETIC 



H. EDWIN MITCHELL 
Deparlanent of Professional Training, Minnesota State Normal Sehool, 

Moorhead, Minnesota. 



The following study^ is presented to illustrate the use which the 
author is making of the statistical method in discovering and in 
determining the relative importance of the various content elements 
of the course of study in arithmetic. Some examples of content 
elements, illustrating what is meant by the term, are ''1-6 gross/' 
"% cup,'' *'% yard," "price per dozen," "4 5/12 dozen articles 
made," and ''10% off regular price." An index of the relative 
importance, from the standpoint of social usage, of the different 
content elements is found in the frequency of their occurrence and 
in the manner of their use, i. e,, whether used in computations 
or merely as descriptive terms. 

The data presented below are taken from four sources, viz., a 
standard cook book, the pay rolls of a number of artificial flower 
and feather factories, marked-down-sales advertisements, and a gen- 
eral hardware catalog. These data are, accordingly, concrete stuff 
out of which arise arithmetical problems of housewives, wage cam- 
era, consumers, and retail hardware dealers, respectively. The 
data are typical of the sort which must be gathered from many 
sources and made the basis of selection of the problems and drill 
exercises w hich are to constitute the course of study in arithmetic. 

^This report is part of a study carried on in Teachers Odlege, under the 
direetion of E. L. Thomdike, during the year 1916-1917. 
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SOCIAL DEMANDS ON STUDY IN ABITHMBTIC g 

A. Data from the cook book. Table I gives the frequency 
of occurrence of cooking-recipe quantities found in the cook book 
examined. Thus ^ teaspoon was found 97 times, % cup was found 
314 times, etc. Of all quantities noted, the number one was most 
frequent, occurring 1836 times, while otne-Tidlf ranks second in fre- 
quency and occurs 1127 times. The median quantity is one. 

The quantities of Table I were taken from recipes intended for 
six persons — ^the thirty or forty other recipes in the book being 
ignored. Consequently, the arithmetical complications which arise 
in adapting the recipes for fewer or a greater number than six per- 
sons consist, for the most part, of taking %, V^, %, or 1^^ times the 
various recipe quantities such as ^, 1%, etc. Other fractional 
parts or multiples of six which might arise in adapting a given 
recipe are probably secondary in importance. 

The most striking feature of Table I is the predominance of 
small numbers. Another striking feature of the table is the great 
frequency of fractions and of mixed numbers. Very significant also 
is the fact that thirds occur as frequently as they do. They occur, 
indeed, four times as frequently as eighths, half as frequently as 
fourths, and a third as frequently as the fraction one-half. 

B. Data from factory pay roUs. Table II gives the frequency 
of occurrence of quantities in dozens found in the weekly pay rolls 



TABLB n 

QUAHTITIES IN DOZENS WHICH ARE ADDED TOGETHER OR ARE MULTIPLISD 

BT INTEGERS, DECIMALS AND lOXED NUMBERS IN RATES PER 

DOZEN IN OOMPUTING THE WAGES OF PIECE WORKERS. 

(Vrom the Pay Rolls of 10 Artifldal Flower And Feather 
Faetoriee, New York, 1010.) 
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of 100 piece workers (t. e., workers paid on the basis of number of 
pieces or ccnnmodities made) selected at random from 300 records 
examined in ten artificial flower and feather factories, New York, 
1916. The table is read : certain workers, selected at random, made 
1/12 dozen articles (at a given rate per dozen), 442 times, 1/6 
dozen articles 18 times, 1/4 dozen articles 292 times, etc. 

To compute accurately the earnings of any given worker, it 
is necessary to add to get the total number of dozens of articles made 
at each of the different rates per dozen, and then to multiply to- 
gether each given rate per dozen and the total number of dozens 
of articles made at that rate. The arithmetical processes involved 
are, therefore, addition of all possible fractions with 12 as denom- 
inator to integers and mixed numbers — ^the fractional parts of the 
mixed numbers likewise include all possible fractions with 12 as 
denominator; multiplication by a fractional, integral, or mixed 
number of dozens, of decimals in terms of dollars and cents; and 
addition of United States money. The following exact copy of a 
pay roll record of one piece worker for one week, will serve as an 
illustration. 

No. made Bate per dozen Earnings 

% doz. 2.25 .75 

Vii doz. 2.50 1.45 

% doz. 2.50 .83 

% doz. 2.50 1.25 

^2 doz. 2.50 2.10 

% doz. 2.50 1.25 

% doz. 2J50 .42 

1 doz. M JSS 

8.60 

To compute accurately the total earnings of this wage earner 
for the week one proceeds as follows : 

% of $2.25=$ .75. 

%,+%+% +i%2+%+%=a%2, or a dozen 

$2.50, the rate per dozen, x ^t the number of dosens, = $7.50 
$ .75-(.7.504- .55=$8.80, total weekly earnings. 

The method of solution used in the office of the factory, on the 
other hand, would lead in this case to an error of one cent in the 
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total earnings. As a matter of fact, the computation of the factory 
office in this case is in error 20 cents — 1 cent on the 7/12 dozen lot 
and 19 cents on the 11/12 dozen lot. 

The question may be asked as to why the factory worker is 
given his work in such small and odd-numbered lots. Why, for 
example, did not the worker whose record is given above receive the 
three dozen articles all at once, or at least in even dozens instead of 
getting first 7/12 dozen, then y^ dozen, and so ont The explanation 
is found in the fact that the orders for goods (which commonly 
include numerous articles of different styles) coming to the manu- 
facturer are numbered as they are received and each employee, at 
any given time, is working on an article to fill a particular order. 
This method of distributing work among employees and the result- 
ing fractions with 12 as denominator were found in 29 other New 
York factories, including manufacturers of men's and women's 
hats and of men's, women's and children's clothing. The custom 
is further encouraged by the universal desire of factory hands to 
have the available work distributed equally. 

Again, the striking features of the data are the predominance 
of small numbers and of fractions and mixed numbers. The frac- 
tions found include and are limited to those having twelve or 
integral factors of twelve as denominators. The fractions one-half 
and twelfths are most common, fourths and thirds next, and sixths 
least frequent. 

C Data from marked-doivn-sales advertisements. The facts 
presented in Table III reveal the nature of the arithmetical oper- 
ations with which the consumer must be familiar in order to under- 
stand the advertisements, or to compute the prices of commodities 
offered, in marked-down sales. The discount rates (including both 
percental and fractional forms) given in the table are the first 300 
seen by the writer and one other person, beginning with February, 
1917. Most of them were taken from one New York daily paper, 
others from store windows and delivery wagons in New York, and 
a few from newspapers outside of New York. The 300 were secured 
in approximately three months' time. They are typical for New 
York City. Because of the commercial importance of New York, 
it is probable also that further investigation will prove them typi- 
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cal for a large part of the United States. Such evidence as the 
snthor has been able to get, thoagh fragmentary, tends to show them 
to be typical for the principal cities of the Missifisippi Valley and 
of the Pacific Coast. 

Table III is read thus: the rate "10 percent off" was fotmd 
twice in advertisements of automobiles and aecesBories, once iu ad- 
vertisements of children's clothing, four times in advertisements of 
fnmitore, et«. The rate "10 percent off" occurred 26 times in all. 
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Tlie outataudii^ f eatare of Table ni is tbat discoaut rates, 
with two notable exceptions, are expressed in percentages, — these 
exceptions are one-TuUf and one-third. Of the 300 marked-down 
rates noted, 70 were sales at half price. Of these 70, 57 are ex- 
pressed by the fraction 1/2 and only 13 by 50 percent. Of the 28 
sales advertiBing a third off, 24 express the discount by % and only 
four by 33^ percent. Again, the expression "^^ to ^ off" occurs 
19 times while its equivalent, 33^^ to 50 percent, is foond bat four 
times. Thus, of the tJjtal number of 125 fractional discount rates 
noted, exactly 100, or 80 percent of them, are % or yt^. The only 
other fractional discount worth noting is ^, which was noted 8 
times as a fraction and 21 times as 25 percent The two most com- 
mon percental discounts, viz., 20 percent and 10 percent, are never 
found in fractional form. In all, 119, or 68 percent of the total 
number of 175 percental discounts noted, are in percentages which 
are not found in fractional form. On the other hand, all the 125 
fractional discounts are sometimes found expressed in their pei> 
cental equivalents. 

In general, the arithmetical operations involved in marked- 
down sales are 10 percent, 20 percent, and 25 percent off, and % 
and ^ off, the regular prices of furniture, articles of clothing, dry* 
goods, notions, and house furnishings. 

D, Data from the general hardware catalog. Tabic IV sum- 
marizes the arithmetical facts found in one wholesale general hard- 
ware catalog. Thus, from the table, 1/16 inch was found four times, 
% inch 4 times, 11/64 inch once, etc. ; 2 feet was found 6 times; 7^ 
ounces was found twice ; 1/6 dozen was given as the number of ar- 
ticles in a box, package, or carton, five times. The list price of 944 
different articles was specified as so much per dozen, of 428 articles 
as so much per grosa, etc. 
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The quantities tabulated in Table lY under units of linear 
measure appear, for the most part, as descriptive terms only, t. e., 
they are not used in arithmetical computations. They tell the linear 
dimensions of bolts, screws, nuts, tanks, etc. The retail hardware 
dealer must be able to read them and must know what they mean. 

The quantities tabulated under units of avoirdupois weight 
are descriptive of the weights of articles. They may also be used 
in determining the shipping weight of one or more articles, and in 
this case would be added together and the sum possibly multiplied 
by a shipping rate. The weights as they are, in case but one article 
was ordered, might be multiplied by the shipping rate. 

The items of greatest significance in Table lY are found under 
the headings "Number in Container" and "Price per.'' The fact 
that commodities are put up in boxes of a do!zen or fractional part 
of a dozen, and the fact that the list price is a rate per dozen, both 
mean that computing the cost of any number of commodities less 
than a dozen would involve fractions having 12 and all the integral 
factors of 12 as denominators. For example, to find the cost of two 
articles listed at a rate per dozen, would require taking one-sixth of 
the list price. In like manner, finding the cost of five articles would 
require taking 5/12ths of the list price. 

Fractions having 12 or integral factors of 12 as denominators 
also enter into computations for finding the cost of any number of 
dozen articles less than 12 dozen, when the number of articles in a 
box or carton is one gross or when the list price is "per gross." 
Such a case would be finding the cost of 2 dozen commodities listed 
at so much per gross — l/6th of the list price would be required. 

Of significance also, although in a negative way, is the relative 
unimportance (as indicated by this catalog) of 100 as a unit in the 
hardware trade. Commodities are listed at a price per hundred 
only 22 times in a total of more than 1500 prices. 

oonolttsiOnb 

The following conclusions are subject to the limitations of the 
data on which they are based. The data do, however, furnish evi- 
dence as to some of the arithmetical activities of four groups of 
individuals. In the cases studied : 
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1. The great relative frequency of small nnmbers, especially 
of fractions and mixed numbers, is significant in its bearing on drill 
exercises and on the form of problems. 

2. It has proved worth while to ascertain the rdative fre- 
quency of the different fractions and other number magnitudes 
which are used in the arithmetical computations of a considerable 
number of people. 

3. The prominence of the dozen as a unit of production and 
of trade suggests the importance of familiarity with the aliquot 
parts of 12. 

4. Although decimalization is one of the distinguishing fear 
tures of present-day arithmetic, tenths and hundredths play but an 
insignificant part as units of production and of trade in com- 
modities. 

5. Discount rates advertised in marked-down sales are most 
often expressed in percents — the most notable exceptions are the 
fractional forms % and % off. Discounts are practically never 
expressed as so many ' ' cents on the dollar, ' ' in marked-down sales 
advertisements. 

6. The method employed in this study is feasible and a part of 
the necessary procedure in the solution of the problem of what 
should constitute the course of study in arithmetic. 



CHAPTER n 

WHAT SHOULD BE THE MINIMAL INFORMATION 

ABOUT BANKING 

ALICE CAMEBEB 
Univeraity of Iowa, Iowa City, Iowa 



The primary object of this study^ was to find out what bank 
employees think the citizens of their community ought to know 
about banking. To get this information the questionnaire that fol- 
lows was mailed to fifty employees of banks. Replies were received 
from thirty-five persons, representing the states of Illinois, Indi- 
ana, Iowa, Kentucky, Missouri, Nebraska, North Dakota, Oregon 
and Texas. To secure still further information, the same questions 
were submitted to parents of the children in the University of Iowa 
Elementary School. 

Questionnaire 

What, from your experience, do you think the citizens of your 
community, or of any community, ought to know about the follow- 
ing items? Please state after each item. 

1. If knowledge of the item is very important put a double 
check (xx) before it. 

2. If knowledge of the item is less important, yet of some 
value, put a single check (x) before it. 

3. If knowledge of the item would be of no value, cross it out 

In the table below the items in question are listed in order of 
their importance as finally determined by the number of double 
checks given them by the thirty-five bankers.* 

The fourth column shows the rank assigned to each item by 
the parents, as determined in the same manner. 

^This study was prepared by Miss Camerer under the direction of Dr. Ernest 
Horn, of the State University of Iowa. The list of questions was originally 
drawn up by Charles B. Bounds, Superintendent of Schools, Fort Thomas, 
Kentucky, 

HHher methods of ranking were tried, like assigning two units to each 
double check and one unit to each single check, but these produced no decided 
alterations in the resulting order of importance. 
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TABLE I 

OW mPOBTANO OV TABI0U8 ITXM8 OT nrTQBlCATZOH OOHJIJOTJD 
A8 BAKKSD BT BAKK SlCPLOTniS AND BT PABlVTf 




It«m 



Number Bank Employee* 
Cheeking mm 



Very 
Importont 



SomewbAt 
Important 



Not 
Important 



Bank 

Order 

Assigned 

Parents 



1 
2 
8 

4 
6 

6 

7 

8 

9 

10 

11 

12 

18 

14 

15 
16 

17 
18 
10 
20 
21 
22 

28 
24 

25 

28 
27 

28 

29 
80 

81 

82 
88 
84 

86 

86 
87 

88 

89 
40 
41 



How to write a ekeek 

How and whj lUl ont the stub. . 

When check shonld be cashed. . 

How to stop payment of a check. 

How to sign yonr name when 
indorsing a check 

What to do in case a check is lost 

How to indorse a note 

How to write a negotiable note. 

How te indorse a cheek in full. . 

How to nse a bank book 

How to make ont a deposit slip. 

How to And interest 

Importance and purpose of say- 
ings banks 

Importance and purpose of com* 
mercial deposit banks 

How to nse a promissory note. . . [ 

Besponsibility of maker if note 
is lost 

Ocrtiiled cheeks 

How to open an account 

When notes are Toid 

Legal rate of interest 

Gertiilcate of deposit 

Puri>ose and use of coUateral 
notes 

How to indorse a check in blank 

How to write a non-negotiable 
note 

How to write a commercial sight 
draft 

Post dated checks 

How to indorse a check, qualified 
indorsement 

How to write a restrictire in- 
dorsement 

How to write a demand note [ 

How to use a commercial sight 
draft 

When notes may or do draw in- 
terest 

How! to write a Joint note 

How to write a collateral note . . 

How to write a note payable by 
installments 

How to write a joint and sereral 
note 

Bate of interest by contract 

How to And date of maturity of 
notes 

Purpose and ralue of accommo- 
dation note 

Where to pay a note 

How to secure a bank draft. . . . 

How to use a bank draft 



28 
28 
21 
19 

19 
18 
18 
17 
16 
16 
16 
16 

16 

16 
14 

18 
18 
18 
12 
12 
11 

11 
11 

11 

11 
11 

11 

11 

10 

10 

10 
10 
10 

10 

10 
9 



9 
8 
8 
8 



7 
11 
14 
16 

16 
16 
16 
17 
16 
18 
18 
18 

17 

17 
19 

22 
21 
20 
24 
21 
28 

21 
21 

19 

19 
17 

14 

14 
22 

22 

22 
20 
19 

19 

18 
28 

22 

16 
26 
25 
24 





1 





1 
1 
1 

8 
2 
2 
2 



8 
2 



1 
2 

1 
2 

1 

8 
8 



5 

7 

10 

10 

8 



8 
6 
6 



7 
8 



11 

1 
2 
8 



8 

2 

14 

28 

6 

26 

17 

19 

8 

4 

1 

18 

16 

20 

16 



29 
6 
86 
18 
12 

84 

9 

49 

81 
88 

21 

40 

88 

87 

85 
89 
46 

41 

46 
80 

26 

64 
24 
10 
11 
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TABLE I (CMdwtfW) 



I. K O 

ogfi 



4S 
4M 



45 
46 

47 
48 

49 
50 
51 
5S 
68 
54 
55 



It«m 



Kamber Bank EmpWrMS 
CkeckiBC «• 



Very 
Importaat 



Proper plftM om » 

aa lAdOfSMMBt 



ehaek to owko 



Parpooo of troadod or jmdcBoat 



I 



to writo a Boto iMijablo oa 

or bofor» a eortaln data 

to aao a bin oi fKchaaffo. ..( 
to writo aa ironelad or 
jmdcmoBt aoto 

Safoty dopoalt Tsalta 

Hov to soeoro a bill of ozehaaffo, 
inlaad or f orolfii 

Hov to OM traTolen' eheekB .... 

Yoaebor cboeks 

Parpoao of dayi of graeo 

How to write a prodaee noto. . . . 

How to OM a lottor of credit. . . 

How to eeeore trarelen' cheeks 

How to sectire a I^ter of credit . 



•I 



Important 



Not 
Important 



Order 

ligB 

by 




5 
5 
5 

4 
8 
2 
2 



ts 




11 


16 


26 




20 




12 


14 


28 




20 




26 




21 




18 


14 


18 


15 


27 




80 




28 


5 



47 
28 
42 
48 
65 
61 
27 
50 



Additional Topics Suggested By Bankers 

1. Why are checks protested t 

2. What becomes of checks after they are protested t 

3. What is an overdraft t 

4. What should the public know about overdrafts t 

5. How notes are discounted. 

6. Duties of bank officials. 



Of the thirty-five returns from the questionnaire, ten answered 
the first request, which was td state after each item what the cit- 
izens of a community ought to know about it. A composite of these 
ten replies follows, keeping as nearly as possible to the phraseology 
and including all points made. The number before each item repre- 
sents the order in the questionnaire. The first number after the 
item indicates its place as shown by the bank employees, which may 
be taken as a measure of its importance from the banker's point of 
view. The second number after the item indicates its place in the 
list as shown by the parents. 
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1, How to open an aooovnt (18-6) 

It known, apply at reeeiTing teller's window, give name, addrees^ and 
deposit slip. Be prepared to name some person of whom inquiry may be made 
as to yonr standing and responsibility. The teller will issoe you a pass book 
with amount of first deposit, give yoa a check book and take a specimen of yonr 
signature for the bank files. 

B, How to use a hank hook (10-4) 

The bank book is used by some banks as a receipt for deposits only. In 
other banks it is used to record checks as well, one side being used for deposits 
and the other side for checks. The pass book should be presented with each 
deposit and should also be balanced at the bank occasionally — ^if an active 
business account, once a month, unless your bank issues monthly statements^ 

5. How to make out a deposit slip (11-1) 

Write, in places indicated, the depositor's name, the date and amount 
in currency, silver and checks. Inst checks separately; make total of all; 
verify sum, and present with deposit at the teller's window so that he may 
check. 

4, How to write a check (IS) 

Fill in with ink, number, date, name of payee and amount, in plaees 
indicated. The amount is recorded both in figures and writing, with the figures 
as near the dollar sign as possible and the writing very near the left end, with 
first letter a capital, and all blank spaces filled with lines to avoid raising. 
The written amount governs payment of check if there is any discrejMiney. 
Write signature very legibly on the last line. Checks should not be given for 
less than one dollar. 

6, Hoiw and why fiU ovt the stub (2-2) 

Fill out by recording the number, amount of check, date and name of 
payee. Subtract amount of check from total of amount brought forward, plus 
deposits since and transfer balance to next stub. This will give you a com- 
plete record of each check issued and show your present balance. 

6, How to indorse a check in hlank (23-9) 

Simply write the name on the back of the check across the left end exactly 
as it is written on the face. If written incorrectly on the face of the check, 
write correctly below the incorrect indorsement. 

7. How to indorse a check in fuU (9-8) 

A check is indorsed in full by the payee 's making it payable to the order 
of some bank or individual and then signing his name. 

8. How to indorse a check, qualified indorsement (27-21) 

Qualified indorsements are not looked upon with favor, though they are 
sometimes used, as : ' ' Pay to the order of John Smith when he has finished a 
eertain piece of work." 

9. How to write a restrictive indorsement (28-40) 

The restrictive indorsement most commonly used is the one which pro- 
hibits a further negotiation of the instrument, as : ' ' Pay to John Smith only. ' ' 
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10. Proper place an a eheclc to» make an indorsement (49-7) 

The proper place for indorsement is on the back of the check at the left 
endy the signature written crosswise. 

11. Hou> to sign your name when indorsing a cheek (5-6) 

Sign your name exactly as it is written on the face of the check; then 
sign again with correct name, if that on the face is incorrect 

If. How to stop payment of check (4-BS) 

The proper way to stop payment on a check is to notifjr the bank on 
which it is dnwn, by letter, giving date of the check, number, amonnt, name 
of payee, whether indorsed and wl^ payment is being stopped. 

15. What to do in case check is lost (S-MS) 

In event of loss of check it is possible to have payment stopped on the 
original by noti^dng the bank on which it is drawn, giving description of the 
chMk. After a reasonable time has elapsed, issue a dupUcate marked so in 
red ink. 

14. Foet'dated checks (BS-SS) 

A post-dated check is one that bears some future date. The check, how- 
ever, does not become valid until its date arrives. If presented for payment 
in advance of its date, the bank cannot honor it, even though the drawer has a 
sufficient balance to his credit. Post-dated checks should not be issued. 

16. When a check should he cashed (3-14) 

A check should be cashed as soon as possible after it is received, the same 
day, if convenient. 

16. Certified checks (17-29) 

Certification is a promise by a bank that it will pay a certain check drawn 
upon it when presented in the regular course with proper indorsement. A 
check is charged to maker's account when certified. The check becomes the 
bank's liability, and it must pay the same on presentation. Certified checks 
are used only in cases of bids on contracts and similar transactions. Certi- 
fication is made by the bank only. 

17. Voucher checks (50-4$) 

Voucher checks are checks with vouchers attached, the voucher giving a 
statement of the purpose for which the check is to be used or a receipt. 

18. Certificate of deposit ($1-1$) 

A certificate of deposit is one issued by the bank stating that a certain 
amount of money has been deposited, payable to a certain party, either on de- 
mand or at a stated time. It is not subject to check and may draw interest. 

19. Safety deposit vaults (47-22) 

Safety deposit vaults are fire-proof and burglar-proof, equipped with 
steel deposit boxes, each locked with two locks and opened only by operating 
both. The keys to one lock are in the possession of the customer, while the key 
to the other is kept by the bank. The box can be opened only by the bank and 
the customer together. These boxes are rented by the year to customers who 
may keep valuables or money therein. 
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go. Imporkmoe and purpose of savings hanks (IS-IS) 

SavingB banks fill a very important place, offering to all classes of people 
an opportunity to set aside a certain part of their income at short intervsls and 
paying them interest compounded semi-annually. Deposits of savings banks 
are generidly invested in real estate mortgages. 

Bl, Importance and purpose of commercial deposit han^ (14-20) 

Commercial deposit banks handle deposits incident to the transaction of 
business. They fadlitate exchange of credit, especially payment by check, and 
finance commercial operations. They accumulate the idle mon^ of a com- 
munity and lend it to individuals and to business interests needing additional 
capital temporarily. 

BB. How to secure travelers' checks ($4-i7) 

Travelers' checks may be secured from banks by simply issuing your 
check for the amount of checks you desire to purchase, plus a commission of 
% percent. They may be used practically as cash, are saife means of cariying 
money, but the holder is sometunes required to furnish identification. When 
travelers' checks are issued, your signature is placed on check and is used as 
identification when you desire to cash them. 

25. How to use travelers* checks (49-28) 

They can be cashed at most hotels and railroad offices. Instructions are 
p.inted on them. 

24, How to secure a letter of credit (66-50) 

Letters of credit may be secured by application at any bank with a check 
or cash to cover value and charges. 

26. How to use a letter of credit (6S-61) 

A letter of credit is used by presenting at some bank or business house, 
which will honor your checks against the letter of credit and indorse the amount 
paid on the back of it. A letter of credit may be used in a foreign place in 
the same manner as a check book where the customer is known. 

26, How to secure a }>%U of ex<^iange, inland or foreign (48-47) 

Make a written application at your bank, something akin to application 
for post-office money-order, accompanied by the cash or its equivalent. 

27. How to use a hiU of exchange, inland or foreign (46-48) 
Follow form used in negotiating checks. 

28, How to use a promissory note (16-16) 

A negotiable promissory note is a promise made in writing by one person 
to another, signed by the maker engaging to pay on demand or at a fixed future 
time, a certain sum of money to order or besurer. When the note is drawn to 
the maker's own order, it is not complete until indorsed by him. The bank 
wiU look after its collection free of chu>ge. 

29. How to indorse a note (7-17) 

If you are guaranteeing payment at maturity or thereafter, the simple 
signing of your name will transfer title and at the same time hold you sec- 
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OBdaiily fiaUe. If 71m wiA to aroid Habflitj in ease of fuliire of 
pajy thai write tte word^ ''widKNit reeoime" aad ap your 

SO. How to write a megaiiahie moU (8-19) 

A lieg o ti aMc note is one for a definite aa o oat y maturing at a ^•^■■^^ 
giren for a Talii^>le eonsidcfatioii, and parable to tke order of a 
or ia i rtiUitm i, witk no eonditiOTS attaehed. 

SU Sow to wfite a aoa-a^^ofiofrle mote (94-49) 
Make it parable to pajee oalj, bj leoTiag out ''or order" or ''or *■■ ■■** 



iaeoarporatiBg in the eontract of the note, the word " noa-afigotiibiB ** 

Jt. How to wriU a demomd mote (89-88) 
Tte tiae denent is left out and in its {daee "On denand" Is 

88. Pwrpo$e amd ralme of aeeomtmodmtiom mote (88-S4) 
An aeeommodation note is one giTen bj one pcmm aoldy for the 



of another, with eonsideration. 

84. Fwrpooe of wvm<tody or jmdgmiemt mote (48-^8) 

An iron-dad. or judgment note pots the cost of collection ob the payer in 
of ant. It is obsolete. 



85. Eow to write am wrm-Hod, or jmdgmiemt mote (46-88) 
Xot importa nt beeanae Terr few states permit tte praeliea. 

86. How to wriir a joimt mote (88-89) 
A joint note is signed bj two parties and states that "We 



57. How to write a joimt amd sevfrsi no<« (88-4$) 
Write it, '*!, we, or either of os^ piomise-^^" and sign by 

83. Pmrpooe amd —t of ooUateral motes (88-84) 

TW purpose of eoQateral notes is to seeore the holder of tte note by 
liidgin^ certain stodo, bonds or other seeority as eoQateial for the 

89. How to write a edOateral moU (88-48) 



A eoOateral note is written in the same f oim as a negetiafaie 
aaffit that it esrries with it an assignment of the seenrity. In 

fsib to disAarge the note, ^e holder has the ri^ to seU tte 



40. How to wrUe a mote pa^le hy iaifeffsiwilt (84-41) 



A note payable by instsDments is written by iaeorporating in the eoatraet 
thst it shall be payable in monthly or weekly iBsteDBeats of a 



41. Horn to write a mt>U pafoble om or htfort • ofrioia dele (44-88) 
Begin Ae sbIb, "On or befbre Jaaoazy 1, 1918 w" 



48. How to w^Ue m pndmeo mote (88^) 
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4S, Purpose of days of grace ($1-48) 

Three days are sometimes allowed the payer of a note in which to pay after 
it is due. It has been abolished in most states^ and others waive it. 

44. How to find date of matturUy (87-26) 

If the time is given in days, connt exact days from the date; if in months^ 
it will be due on the same date of the month of maturity as the date of the note^ 
according to bankers' rule. The date is usually found by a maturity table. 

46. Where to pay a naie (S9'g4) 

Most notes provide for their payment at a certain bank or office. If not 
stated in the not^ it is payable at the office or residence of the( payee. 

46. BesponsibUity of maker if note is lost (16-44) 

The maker is responsible if the note can be proved, but he may require a 
bond indemnifying him against repayment. 

47. When notes are void (19-36) 

Notes are void if given by a minor, or an incompetent, if forged, obtained 
by fraud or under false pretenses. 

48. When notes tiuvy or do draw interest (81-85) 

Notes draw interest when it is so stated in the contract. A promise to 
pay with interest but without stating the rate, provides for interest at the legal 
rate. 

49. Legal rate of interest (80-18) ^ 

State statutes govern rate of interest by providing minimal and maximal 
rates that can be lawfully charged. 

60. Bate of interest "by contract (86-80) 

Any rate up to and including S percent is legal in Iowa. The maximum 
prescribed by law in different states varies. 

61. How to write a commercial sight draft (86-81) 

''At sight, or at so many days" sight, pay to the order of, and charge 
same t6 the account of (name). 

68. How to use a commercial sight draft (80-87) 

Make it payable to your bank or to yourself, indorse and handle as yon 
would a check or other negotiable instrument.. 

68. How to secure a bank draft (40-10) 

A bank draft is secured by making application at your bank and giving 
them the name of the party to whom you desire to make the draft payable, and 
the amount in cash or check to cover draft and charges. 

64. How to use a bank draft (41-11) 
May be mailed in an ordinary letter and cashed just as a check. 

66. How to find interest (18-18) 

(1.) Use interest tables. (2.) Other ways: (a) Multiply amount by 
rate and time, (b) Point off twx) places for 60 days at 6 percent and work 
from that^ (c) Multiply sum by number of days, point off two places, divide 
by 60 for 6 percent, by 72 for 5 percent. 



26 TEE SEVENTEENTH YEABBOOK 



BIBUOGRAPHT 

(1) Bolles, A. S.y Money, Banking and Finance, 1903. 

(2) Cleveland, F. A., First Lessons in Finance, New York, 
1903. 

(3) Cleveland, F. A., Funds and Their Uses, New York, 1904, 

(4) CoflSn, G. M., The A. B. C. of Banks and Banking. New 
York, 1901. 

(5) Baton, H. T., The Work of a Bank. London, 1916. 

(6) Fiske, A. K., The Modem Bank. New York, 1904. 

(7) Harris, B. S., Practical Banking. Boston, 1915. 

(8) Herrick, Clay, Trust Companies. 1915. 

(9) Kirkbride and Sterrett. Modem Trust Companies. New 
York, 1906. 

(10) Kniffln, W. H., Practical Work of a Bank. 1915. 

(11) Kniffin, W. H., Savings Bank and its Practical Work. 
1912. 

(12) Scott, W. A., Money and Banking. New York, 1910. 

(13) Tompkins, L. J., Law of Commercial Paper. New 
York, 1913. 

(14) White, Horace, Money and Banking. Boston, 1911. 

(15) Willis, H. P., American Banking, Chicago, 1916. 

(16) Willis, H. P., Federal Reserve. New York, 1915. 

(17) Williston, Samuel. Negotiable Instruments. 1915. 

(18) Bankers' Magazine. 

(19) Journal of American Bankers Association. 

(20) State Law on Negotiable Instruments. 

(21) Pratt, A. S. & Sons. Pratts' Digest of National Bank- 
ing Laws. Washington, D. C, 1908. 

(22) Phillips-Anderson. Silver Burdette Arithmetic Com- 
plete Book. 1913. 

(23) Walsh-Suzzalo. Arithmetics; BuMness and Industrial 
Practice. 1914. 

(24) Finney & Brown. Modem Business Arithmetic. New 
York, 1916. 



CHAPTER III 

THE DETERMINATION AND MEASUREMENT OP THE 

MINIMAL ESSENTIALS OP ELEMENTARY 

SCHOOL GEOGRAPHY 



M. E. BEANOM AND W. C. REAVIS 
Harris Teachers College, St. Lauis, Mo. 



In the few attempts that have been made to select minimal 
essentials in geography, emphasis has been placed, almost exclus- 
ively, on place geography. Minimal place material has been se- 
lected (1) through the individual judgment of a teacher or geog- 
raphy specialist, (2) through the collective judgment of a number 
of teachers or geography specialists, (3) through a comparison of 
the relative emphasis given to certain materials in textbooks of 
geography, and (4) through a study of the frequency with which 
place names occur in newspapers and magazines. 

By the individual judgment method there will be as many lists 
of minimal essentials as there are individuals. By the collective 
judgment method, a list may be selected that will represent the 
combined judgments of the group. Since it is largely the work of 
specialists in geography to determine the content, and of adminis- 
trators to adopt methods that will insure the mastery of content, 
the judgment of a group of specialists regarding minimal essentials 
should be more nearly right than the judgment of a group of 
teachers. 

The individual judgment method was used, presumably, by Mr. 
Thompson^ in his exercises in minimal essentials ; and by Superin- 
tendent Witham^ in establishing ''A Minimum Standard for Meas- 
uring Geography" in the sixth grade, who states that he sought 

^Thompson, T. E., Minimum EsseniiaU in Geography. 

'Witham, Emeet C, A minimum standard for measuring geography, Amer- 
ioan School Board Jowmal, 50: Jan., 1915, 13. 
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''to measare the pnpilfl' knowledge and geographical thinking" of 
the United State with a list of fifty-five qnestions to be answered in 
forty-five minutes. 

The collective judgment method of specialists is illustrated 
by the work directed by Professor Whitbeck* in the Cornell Uni- 
versity Summer School in 1910. Professor Whitbeck believed that 
the 'scrappy' and unreliable character of the geographic knowl- 
edge of college students resulted from the superficial teaching of 
many facts, without sufficient emphasis on important facts. With 
the aid of a class of experienced schoolmen, a minimal list of the 
cities of the woiid was selected, and submitted to the consideration 
of a committee of six expert geographers. All cities of the United 
States approved by at least two of the experts, and all cities of the 
rest of the woiid approved by at least three of the experts, were 
included in the final TninimAl list. The results were as foUows: 
25 cities of the United States; 8 of the Western Hemisphere, ex- 
clusive of the United States; 16 of Europe: 8 of Asia; 8 of Africa, 
Australia and the scattered islands. The object of this list was not 
to restrict the pupil's knowledge of other cities, but to secure 
a select group of cities of distinct value in the world of affairs, for 
which pupils might be held strictly responsible. 

The collective judgment method was also foUowed by a group 
of teachers of Springfield, Illinois, working under the direction of 
Professor D. C. Ridgley,* in 1914, with respect to the fourth and 
fifth-grade work. As a result, the following number of place names 
was recommended and adopted for these grades in the Springfield 
Schools: World 30, North America 27, United States 143, South 
America 35. Asia 39, Africa 19, and Australia 11. 

The textbook method applied by Dr. W. C. Bagley* to the con- 
tent of history could be used similarly with geography, but, in so 
far as the writers know, it has not been applied sufliciently to jus- 
tify a report. This method, however, is in effect substantially the 
same as the combined judgments of experts. 

'Wbitbeek, B. H., Where shall we lay the emphasis in teaming geography. 
Education, 31 : Oct., 1910, 108-16. 

^Ridglej, D. C, The teaching of place geography, Journal of Geography, 
11 : Sept., 1912, 13-16. 

•Bagler, W. C, The eoDtent of American history, Bull No. 16, UniverHiy 
of lUinoU School of Education. 
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The last of the methodB employed, that of selecting a minimal 
list of places on the basis of frequency of mention in current liter- 
ature, was reported by Dr. Bagley* in the Fourteenth Yearbook, 
The results of this investigation were inconclusive, but indicated 
that such a method, if taken alone, would be unsatisfactory as the 
basis for the selection of minimal essentials. 

The writers of this article hold that any list of minimal essen- 
tials in geo^rraphy that does not emphasize relational facts as well as 
facts of place is inadequate. According to the modem conception of 
geography, relations between life forms and their environments are 
important. Place geography may be taught incidentally as needed 
in a proper connection with relational geography, subsequently to 
be supplemented by special drill work if necessary. In offering a 
list of minimal essentials, the writers have attempted, therefore, 
to set up certain standards for the selection of the facts that should 
be learned, and for the relations that should be recognized and 
appreciated. 

It is conceded that the standards chosen can be justified only 
to the extent that they will permit the selection of minimal essen- 
tials that will test whether or not the aims of geography teaching 
are being realized. The aims of geography teaching are to impart 
the more important facts of conventional or practical value ; to se- 
cure on the part of the pupil ability to interpret properly the geo- 
graphic factors that enter into problems of timely moment ; and to 
develop an appreciation of the importance of the United States 
intrinsically, and its relational aspects to the world as a whole. 

The realization of these aims requires a general knowledge 
of (1) the relative location of the large land and water bodies, 

(2) the location of the more important countries of the world, 

(3) the location of the more important cities of the world, (4) 
the physical conditions of the more important countries, (5) the 
occupations of the people and the conditions of transportation, 
(6) our commercial relations with these countries, and (7) the 
fundamental relationships between the physical factors and human 
activities. 



'Bagley, W. C, The determination of TniniiniiTn essentials in elementary 
geography and history, Fourteenth Yearbook of this Society, Part I, 131-147. 
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In determining a mininial essential list of eoontries of the 
world, the following standards were empk^ed: (1) the area of the 
country in square miles, (2) population, (3) total value of imports, 
(4) total value of imports from the United States, (5) total value 
of exports, and (6) total value of exports to the United States. 
These criteria not only offer objective data of great significance in 
the study of a particular country, but also afford a means of meas- 
uring the relationships of the United States to other countries. 

The statistical data for each of the above criteria were secured 
from the Statistical Abstract of the United States (1915) in which 
reports covering the latest year for which statistics were available, 
for the fifty-two more important countries of the world, were given. 
The countries were ranked according to their relative importance 
with respect to each of the six criteria and have been numbered 
accordingly in Table I that follows : 

The fifty-two countries of Table I were then divided into quin- 
tiles under each of the six criteria previously discussed, and valo^ 
were assigned to rank in the various quintiles as follows: (1) rank 
in the first quintile in each criterion received a score of 5 points; 
(2) rank in the second quintile, a score of 4 points; (3) rank in the 
third quintile, a score of 3 points ; (4) rank in the fourth quintile, 
a score of 2 points; and (5) rank in the last quintile, a score of 1 
point. The total score thus received by a country would serve as 
an index of the relative importance of that country among the 
countries of the world in area, population, import and export trade ; 
and of its relative importance to the United States in import and 
export trade. 

Table II indicates the total score of each country, by this 
method. These scores range from 30 points, a perfect score, in the 
case of the United States to 6 points for Liberia. An examination 
of the scores clearly indicates the greater importance of certain 
countries, and suggests the desirability of establishing a line of 
demarcation between the important and less important countries. 
This is exactly what the movement for economy of time in educa- 
tion seeks through a scientific determination of essentials. It 
is recognized that the placement of this line is at first a some- 
what arbitrary matter, and that through experimental evidence 
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or radical changes in statifltical data, some readjustment may be 
desirable. However, the score of 20 points, the lower limit of 
the second quintile, seems to offer the most satisfactory place for 
a tentative limiting line for minimal essentials. This places twenty- 
one countries in the ** minimal essential list" These should receive 
a more comprehensive treatment than would be given to the re- 
maining thirty-one countries. 

In the selection of a minimal list of cities, several factors such 
as import and export trade, advantages of location, importance of 
hinterland, and advantages of transportation, were tried as stan- 
dards ; but the lack of sufKcient data for many cities rendered such 
work unsatisfactory. A very dose correlation, however, was found 
to obtain between these standards in cases where such data were 
available and the single standard of population. It was decided, 
therefore, to use the standard of population as a criterion for de- 
termining the list of cities. After considering the list of cities de- 
termined by the single standard of population, it was believed that 
the largest city of each of the 21 'essential' countries of the world 
(as previously determined) should be included in the list, with the 
addition of all other cities of more than 200,000 population in the 
Western Hemisphere, of all other cities of more than 600,000 popu- 
lation in Europe, and of all other cities of more than 800,000 popu- 
lation in the rest of the world. This standard of population was 
established on the basis of American relations to the different reg- 
ions of the world. 

This gives a lisf^ of 29 cities for the United States ; 10 for the 
Western Hemisphere, exclusive of the United States ; 18 for Europe ; 
and 9 for Asia, Africa, Australia,' and the scattered islands. All 
of these are located in the more important countries, and the pupil 
will have an opportunity to express judgment on them (excepting 
Havana, Montevideo, and Santiago) in the completion test that 
follows. 

In selecting a minimal list of products, dependence has been 
placed upon the value of production in the United States, supple- 
mented by the value of products imported into the United States. 
The aggregate value of a class of products may be large with large 

'See for complete list of cities the completion test that follows. 
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quantities in use, and a low price ; or with small quantities in use, 
and a high price. Neither price nor quantity is an exclusive index 
of the importance of the products to man. Ranking products in 
order of aggregate values has the advantage of taking both these 
factors into consideration. 

Banking the products on the basis of the aggregate values of 
each product for aU countries is desirable, but, because of unsatis- 
factory data, impracticable. Fortunately, from a somewhat differ- 
ent point of view statistics almost as satisfactory can be obtained. 
Recent world events have brought out in an emphatic manner the 
commercial dependence of every first-class power upon practically 
every part of the earth. The United States, consequently, either 
produces practically aU important materials or imports them in 
important quantities from other producing areas. Hence, a con- 
sideration of the products of the United States and the products 
imix)rted into the United States offers a comprehensive list of the 
world's industrial products. 

Only the more significant of these products should be included 
in the minimal essential list.^ It has been assumed that all plant, 
animal, and mineral products with a production value in the United 
States of $5,000,000 or more, annually, should be considered ; and 
that this list should be supplemented by all products, not otherwise 
included, imported in quantities valued at $5,000,000 annually. 

Irrespective of values, however, materials of general distribu- 
tion, such as hay, clay, sand, and stone, or materials, such as mush- 
rooms, for which information concerning distribution is inadequate, 
have been omitted. 

In working out the relational material, it has been assumed that 
location, area, surface features, soils, climate, distribution of plant 
and animal forms, and distribution of minerals are the significant 
physical factors. The pupil's knowledge of geography, however, 
has not been tested sufficiently unless he has shown his appreciation 
of the ways these factors have influenced man, and unless he shows 
his ability to select important factors that enter into a geographic 
problem. We recognize the difficulties involved in testing rda- 
tional geography, and the relative simplicity of testing place geog- 



•For this list of prodaets see Part IH of the completion test that follows. 
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raphy. The mere testing of place knowledge, however, reveals a 
very limited amount of the modem geographic knowledge demanded 
of a pupil. As a matter of fact, place geography may be taught 
solely by means of drills ; or it may be taught incidentally in con- 
nection with the solution of geographic problems. The place tests, 
since they do not indicate whether relations were developed, or 
merdy taken for granted, manifestly do not measure the most vital 
part of geography. 

After this body of minimal material has been taught with suf- 
ficient and satisfactory emphasis, a measure of the results can be 
made by the use of the following completion test. It should be 
noted in this connection that Part III may be adapted to any areal 
unit, whether political or geographic, but with slight modification. 
It is hoped, therefore, that the test will prove helpful to those who 
may wish to test a geographic province or a part of a country, as 
well as to those who desire to apply it to political units only. It 
is not intended that any group of pupils needs to react to all of the 
twenty-one important countries, along the lines indicated in this 
part of the test. It is suggested, however, that the test be given 
for at least three of the major countries, and that the results thus 
obtained be averaged and regarded as an index of the pupil's 
knowledge in general of other countries. 

COMPLETIGN TEST FOR THE MEASUREMENT OF MINIMAL GEOGRAPHIC 
KNOWLEDGE OF ELEMENTARY SCHOOL CHILDREN® 

Pupil Age Grade School 



PART I 

On a 9x12 unlettered outline map of the world, indicate the 
location of the continents and oceans by writing the names in the 
proper places. Time limit, 3 minutes. Allow i^ point for each 
continent or ocean correctly located. Possible score, 5.5 points. 

PARTH 

On a 9x12 unlettered outline map of the world, write in the 
correct place the name of each of the following countries : United 

*For the values of the several exercises, see the score caxd that follows. In 
ease of doubt regarding correctness of the pupil 's response to an exercise, it is 
recommended that he be given the benefit oi the doubt 



Stateiw Great Britiaii, GcmttB?-, Fnfiee^ ImdOM^ Italj, BoHia, Gui- 



• r 



ludiy Mexieo, Bdgiiim. Australia. Spam. SvedeB. E^rp^ Tukej. 
lime limit, 5 minntca. ABov i* P<3<^ 'o^ c*^ ci"in^ If^cated 
cometij. PoasOile aeore, 10^5 pobna. 



PAST m 



1. Gire the directian of this cciiiixr7 from joiir h o t city 



2. Gire in aqoare miles the appraximate area of the Uiuted 

States Underline the term that sMve neady cx- 

preases the am of the aboTe-named foontTx^ in empazisan with 
the United States : Lareer SmaUer Appnaximatehr the nine. 

3. GiT« the apprariinate popuLaiion of the United Statea 

Underline the term that mct^ nearly i liufasis the 

popalatioa of the above coontry^^ in eomparnon vith the United 
States: Larger Smaller Approximateij the same^ 

4. Xsme an in^Mirtant highland of this eountzy 

5. Underline the statements that more neailr indieale the 
prevailing eonditiocs of this highland: 

Ea^ to eroas Dense population No large eitiea 

KnwMti above tree Permanent snovfidds H«ding indu s tr y im- 

fine Mneh mining portant 

dties DiflBenh to 

6. Xame an important rirer basin of this country. 



7. Ucfierline the statements that more nearly indicate the 
prerailzng conditicaia eonceming this lowland. 

Dtaam population Much minmg Manufaeturing im- 

Brrer impr>rtant for Much swamp and ov- p<Mtant 

narigxtioa erflow land Sparse population 

Irrigatiion practiced Agriculture import- Herding important 

ant 

of &» Umfttd Slataa 
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8. Underline the statement that describes the prevailing tem- 
peratore of the country : Primarily in hot belt Primarily in cold 
belt Primarily in intermediate belt. 

9. Underline the statement that describes the prevailing rain- 
fall: Heavy rainfall (Above 50 in.) Moderate rainfall (20 to 
50 in.) Light rainfall (Less than 20 in.) 

10. Underline the name of each plant product that is import- 
ant in this country: 



Com 

Wheat 

Oats 

Barley 

Bye 

Buckwheat 

Potatoes 



Cotton 

Tobacco 

Flax 

Bice 

Sugar 

Apples 

Beans 



Peaches 

Peas 

Silk 

Cocoa 

Coffee 

Tea 



Lemons 

Fibres 

Bubber 

Bananas 

Grapes 

Nuts 

Wood 



Oranges 

11. Write the name of one of the products underlined above 
Underline its important use or uses: 



Food for man 
Fuel 



Clothing 
Shelter 



Luxury 

Food for animals 



12. Underline the name of each animal that is important in 
this country: cattle hogs sheep horses mules goats poultry 

13. Write the name of one of the classes of animals under- 
lined above Underline its important 

use or uses : 

Meat Milk Clothing Eggs Beast of burden 

14. Underline the name of each mineral product that is im- 
portant in this country : 

Coal Nickel Natural gas Lead 

Iron Copper Tin Zinc 

Petroleum Qold Silver Aluminum 

Phosphates Sulphur 

15. Write the name of one mineral product underlined above 
Underline its important uses or use: 

Fuel Alloy Paints 

Machinery Light Plumbing supplies 

Fertilizer Jewelry Chemicals 
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16. Underline the preTailing mannfartnring conditions: 
ExtensiTe Moderate Slight 

17. Underline the influential factors in the develoDment of 



manofaetaring: 








Good water power Scarcity of coal 


InsuScient labor 


Mnch coal 


Abundant capital 


supply 


Abundant labor 


Little water power 


Scaraty of capital 


supply 








18. Underline statements that properlv 


describe the prevai 


ing conditions of transportation 


• 
• 




Rivers important Railroads 


well de- 


Public roads well 


Rivers of little i 


im- veloped 




improved 


portance 


Railroads undevel- 


Public roads in bad 


Lakes verv important oped 




conditicm 


Lakes of little im- 






portance 








19. Underline each of the cities of this country : 


Washington 


Boston 


Philadelphia Toronto 


London 


Buffalo 


Pittsburgh 


Budapest 


Berlin 


Chicago 


Portland 


Glasgow 


Paris 


Cincinnati 


Providence 


Ilamburg 


Petrograd 


Cleveland 


Rochester 


Liverpool 


Vienna 


Columbus 


St. Louis 


ilanchester 


Tokyo 


Denver 


St. Paul 


Moscow 


Rio de Janeiro 


Detroit 


San Francisco Naples 


Buenos Aires 


Indianapolis 


Seattle 


Warsaw 


Mexico City 


Jersey City 


New York 


Bombay 


Brussels 


Kansas City 


Bahia 


Canton 


Sydney 


Los Aniseles 


Havana 


Hankow 


Madrid 


Louisville 


Montevideo 


Osaka 


Stockholm 


Milwaukee 


^lontreal 


Tientsin 


Cairo 


Minneapolis 


Santiago 


Calcutta 


Constantinople 


Newark 


Sao Paulo 


Amsterdam 


Baltimore 


New Orleans 
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20. Write the name of one of the cities underlined in the pre- 
ceding exercise Underline the statements that 

properly describe this city : 

Seaport Important railroad An important mana- 

River port center facturing center 

Lake port A political capital An important com- 

A mountain paas city mercial center 

Time limit 30 miuatce. 
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CHAPTEBIV 

ANALYSIS OF THE VOCABULABIBS OF TEX 
SECOND-TEAB EK%DKBS 



The gcnenl purpomt of this sta4?' h to detCRBine nentifiemlly 
the Toeibulmry of ten Seeond Readfn m tammmi imt in fte Amer- 



The p<^ndar notkn that one aeries of readen it nperior to 
anothpT » baaed lajigdj upon a f edrng of like fat, or Ariike of, one 
or the other aeries, and not nponafaasis of arientifie eampariaon. 

At preaent readers are selected upon a basis of * general merits ' 
but 'general merit' is a looae and undefined tenn. To aone^ who 
are primarilT interested in the quality of JPnarratinns^ the 
emrtent is not ao important : others are interested in the mfriianiral 
make-np ; while others riew the reading problem fron fte literaiy 
point of Tiew odIt, oreriooking the other qualitiea. 

This stady represents an attempt to find a basis for measuring 
the quality of readers in ao far aa the Toeabolaiy of theeereadem 
is a factor in detennining their worth. The stndy (1) determinea 
the entire Toeabulazy of each of the ten readers, (2) deteoninea 
their eonmion ToeaboIaiy, (3) ecxnpares the Toeabolaries of the 
'method' and 'eontent' readers, and (4) shows hy means of the 
Toeabolaries the rdations between these two kinds of readers. 



The mafiTials for the investigation are ten aeeond-year readers 
from widdy known aeries. The adection of readers was made with 
no idea of naing the ten best aeries or eren the ten moat extezunrdy 
need in the state of Iowa. The list was taken, excepting in two or 

40 
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three instances, from Superintendent Jones' stady oovering the 
United States, and represents the highest frequencies in the country 
as a whole. 

The list includes three 'method' readers — ^namely, the Rationdl 
Method in Reading by Ward (1899 ed), the Aldine Second Reader 
(1907 ed), the Beacon Second Reader (1914 ed), and seven 'con- 
tent' readers, namely, the Riverside Second Reader (1911 ed.), the 
Elson Primary SchM Reader ^ Book II (1913 ed.), the Cyr Reader, 
Book II (1901 ed.), the New Education Reader, Book II (1900 ed.), 
the Baldwin and Bender Reader (1911 ed.), the Heath Second 
Reader (1903 ed.), and the Gordon Reader, Second Book (1910 ed.). 

METHOD 

The words of each of the ten readers were first counted, page 
by page, and each word listed, t<^ether with the number of times 
it occurred on the page. From this page list the vocabulary of 
each book was tabulated in a combination of an alphabetical and 
group system, together with the frequency of recurrence of each 
word in the entire book. From these vocabularies a tabulation was 
then made showing the entire vocabulary of the ten books arranged 
in the same order as the separate vocabularies, and containing the 
word-frequencies, as shown later. 

The ten readers together comprised 1566 pages, with a total 
of 143,789 words. Minor errors in counting may have occurred, 
but could not have greatly influenced the totals. 

RESULTS 

Below is given the vocabulary that is common to the ten second 
readers included in this study, together with the frequencies of 
each word that appeared 14 times or more. Throughout the study, 
every difference in spelling is counted as a new word. 

yoa 1866 they 1199 on 923 

it 1737 the 1190 bo 901 

of 1616 that 1170 at 890 

is 1593 his 1073 her 883 

said 1344 not 1068 me 822 

UtUe 1430 for 1025 aU 804 

was 1224 wiU 952 then 802 



the 


10429 


and 


4631 


to 


3896 


a 


3818 


I 


2888 


he 


2346 


in 


1997 
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MM 


786 


but 


767 


are 


766 


my 
one 


737 
696 


do 


691 


be 


684 


bad 


678 


witii 


675 


bave 


623 


wbat 


613 


bim 


607 


tbem 


606 


see 


598 


tbero 


589 


go 
ap 

Tory 

wben 


565 

561 
537 
531 


we 


514 


no 


490 


out 


483 


coma 


478 


tbia 


471 


day 
can 


461 
460 


did 


454 


motber 


426 


away 
old 


426 
426 


WCT6 


419 


yonr 
bow 


415 
418 


now 


387 


soma 


384 


irom 


366 


into 


365 


eoold 


356 


would 


354 


boy 
down 


343 
343 


if 


842 


by 
ob 


340 
328 


came 


323 


wbo 


806 


tree 


303 


big 
am 


301 
300 


like 


300 


thnr 


299 


good 

get 

time 


294 
293 

287 



baa 

saw 

make 

know 

booae 

long 

most 

made 

let 

ran 

tbink 

aboot 

man 

look 

take 

pret^ 

went 

bere 

too 

wbere 

well 

put 

giro 

may 

tell 

OTor 

joat 

never 

back 

many 

again 

water 

wby 

as 

Bball 

eacb 

bappy 

tbongbt 

wbite 

ben 

dear 

its 

our 

eat 

soon 

cbildren 

more 

going 

every 

plan 

poor 

bird 

great 

wind 



273 



261 
260 
257 



m 

bwked 

off 

money 

moniing 

door 



251 
250 
237 
237 
236 
232 



225 
223 
222 
220 
217 
215 
212 
211 
211 
210 
209 
209 
208 
208 
201 
201 
200 
199 
198 
193 
186 
186 
186 
183 
182 
180 
180 
179 
179 
178 
168 
167 
166 
166 
166 
164 
164 
164 



dog 

find 

an 

belp 

red 

two 

asked 

only 

girl 

»y 

want 

flowers 

last 

npon 

or 

tbree 

yes 

father 

leaves 

run 

otber 

hear 

gave 

dent 

sing 

kind 

been 

before 

keep 

eyes 

found 

began 

first 

lived 

nigbt 

beautiful 

these 

thou 

much 

cried 

after 

another 

brook 

nest 

sun 

took 

fire 



163 


bead 


163 


birds 


161 


fifi^ 


160 


beard 


160 


under 


159 


does 


154 


stm 


154 


baby 


153 


fly 


153 


bm 


151 


song 


151 


any 


151 


wmrm 


149 


always 


149 


around 


149 


called 


146 


child 


146 


sleep 


143 


should 


143 


told 


141 


boya 


140 


ever 


140 


throui^ 


140 


afraid 


139 


please 


139 


things 


136 


ground 


135 


«ky 


134 


while 


132 


right 


131 


voice 


131 


bright 


130 


better 


128 


flew 


128 


Uve 


128 


love 


126 


wish 


126 


fast 


125 


himself 


122 


place 


122 


sweet 


122 


until 


121 


which 


121 


bear 


121 
120 


spring 
gW 


119 


strong 


118 


hand 


118 


near 


118 


brother 


118 


says 


118 


work 


115 


best 


lis 


sometimes 



113 
ill 
HI 
HI 
110 
100 
100 
107 
107 
107 
106 
104 
104 
103 
103 
103 
103 
103 
102 
102 
101 
101 
101 
100 
100 
98 
97 
97 
97 



95 
94 

94 
94 
94 
94 
93 
98 
93 
93 
98 
93 
92 
92 
90 
90 
89 
89 
88 
88 
88 
87 
86 
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caU 


85 


soft 


68 


carry 


52 


sad 


40 


hone 


85 


food 


67 


indeed 


52 


kept 


40 


fiHh 


84 


full 


67 


angry 


51 


cross 


39 


cold 


83 


together 


67 


clear 


51 


often 


39 


nice 


83 


com 


66 


stock 


51 


threw 


39 


something 


83 


lay 


66 


book 


50 


anything 


38 


tiU 


83 


catch 


65 


wings 


50 


pleased 


38 


bring 


81 


field 


65 


garden 


49 


heart 


38 


shoes 


80 


done 


63 


stay 


49 


nor 


37 


woman 


80 


round 


63 


stop 


49 


shine 


87 


name 


79 


such 


63 


window 


49 


wide 


87 


grow 


79 


thank 


63 


guess 


48 


word 


87 


small 


79 


new 


62 


oak 


48 


earth 


86 


sat 


78 


dark 


60 


picked 


48 


felt 


36 


wise 


78 


bread 


59 


fat 


47 


follow 


86 


yellow 


78 


large 


59 


jumped 


47 


years 


36 


black 


77 


rest 


59 


named 


47 


rain 


35 


far 


77 


asleep 


58 


ready 


46 


deep 


34 


looking 


77 


bam 


58 


everything 


45 


mind 


34 


open 


77 


but 


58 


joy' 


45 


soft 


34 


snow 


77 


dress 


58 


met 


45 


golden 


33 


woods 


77 


eggs 


58 


own 


45 


learn 


33 


got 


76 


town 


58 


show 


45 


stand 


33 


grass 


76 


air 


57 


use 


45 


gentle 


32 


high 


76 


cAnnot 


57 


across 


44 


sent 


32 


winter 


76 


goes 


57 


alone 


44 


true 


32 


coming 


75 


talk 


57 


bad 


44 


sell 


31 


feet 


75 


green 


56 


brown 


44 


winning 


30 


feU 


75 


light 


56 


fun 


44 


sail 


30 


gold 


75 


set 


56 


hole 


44 


forget 


29 


jump 


74 


stop 


56 


leaf 


44 


then 


29 


gone 


73 


brought 


55 


ride 


44 


neck 


28 


room 


73 


hay 


55 


almost 


43 


beside 


27 


seen 


71 


care 


54 


lady 


43 


yourself 


27 


behind 


70 


summer 


54 


eating 


42 


pup 


26 


blue 


70 


to-day 


54 


set 


42 


six 


25 


might 


70 


try 


54 


side 


42 


crept 


24 


rose 


70 


walk 


54 


those 


42 


mine 


24 


hard 


69 


brought 


53 


among 


41 


feel 


23 


wanted 


69 


face 


5.1 


hat 


41 


hope 


22 


fall 


68 


hold 


53 


need 


41 


ten 


20 


nothing 


68 


watch 


53 


running 


41 


middle 


18 


river 


68 


basket 


52 


top 


41 


lame 


14 



A large percentage of these words occurs but one, two or three 
times in any single reader, as is made dear in the tables which fol- 
low. This seems to afford too little provision for drill and review. 
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TABLE TL 

OF W0BD8 OOOUBUVO 1, 2 JJTD 8 mOI, BT 



Vunberof tiam 
oeeurriiiff 


BlwA Ward BAB Aldina NevSd. Oordoa Vtwm- Qjt BmA 

Mb 


Bm^ 


1 
2 
8 


641 826 472 578 650 592 
268 829 802 844 250 259 
187 147 166 161 158 184 


488 687 487 
218 288 268 

128 111 107 


818 
841 
188 




TABLE m 


MBTnAmi. 




nOKJUlTAUB UF WtJHIW UUUUBBUiU X, S AMU 9 TUt 




Hunber of tiiBM 
oeeurriiiff 


Elaon Ward BAB Aldine New Ed. Gordoa Birar- Qjr BmA 

Mb 


B4MM 


1 
2 
8 


88.56 48.47 80.74 84.12 89.20 42.68 

18.77 17.81 10.67 20.81 15.06 18.67 

0.97 7.74 10.81 9.50 0.28 0.78 


80.08 87.06 84.08 

14.62 10.86 20.48 

8.78 0.26 8.88 


21.66 
28.28 

8.40 



The three following percentage tables ahow the nnmber of 
words in the vocabularies of all of the ten books, the common yo- 
cabnlaries of these books, the nnmber of new words in the cont^it 
readers as compared with the method readers, the ratio of common 
words to the new words expressed in percents, and the percentage 
of words f onnd in each of the books as compared with the vocab- 
ulary of the selected basic text. 

When children have completed their basic text, the question 
of supplementary reading material must be raised. The writer 
has found a wide divergence of opinion upon this subject, but so 
far has not been able to discover any authoritative conclusions as 
to what should constitute the basis of selection. Opinions as to the 
proper number of new words in a supplementary reader vary from 
those that advocate the greatest number of new words possible for 
a reader to those at the other extreme, who advocate the smallest 
number possible. It has also occurred to some to strike a happy 
medium between these two extreme positions. It seems possible 

TABLE rv 

▲ mrmoD bbadmb (wabd) oompabsd with thb sxwmx ooirmrT mmAPWEi vos na 



FUBPOra OV 1 


luaossmro svppiJUcnTABT matibiaii 








Ward 


OjT 


Heirth 


QosdoB 


BAB 


BiTor. 
■Ida 


New Ed. 


Elsoa 


Total mniilMr ai 


















dUfcrmt words 


1900 


1198 


1248 


1887 


1585 


1457 


1658 


1010 


Hmwhtf of words 








- 










eonunon to sO t«n 


















rosdsrs 


419 


419 


410 


419 


419 


410 


419 


419 


HuBbv OK words 


















not lovAd in Ward 




518 


580 


611 


657 


678 


984 


972 


Vunber o< words 


















loaiid in Ward 




680 


695 


776 


878 


770 


724 


028 
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that children cannot learn to read fluently if continually hampered 
by new word forma. It seems evident also that a reader with too 
small a number of new words would not be the most desirable as 
a supplementary text. 

TABLE y 

▲ 8B00VD lOTKOD BBADMB (ALDZmi) OOMPABSD WITH TES BSVBK OOHTBirT mmAPMM VOB 



THS PUBPOn OV BUOQmmXQ BUPPIiUOUrTABT MATBBIAI 



J 



Aldine Oyr Heath Gordon Rirer- BAB New Ed. EIma 

tide 



Total number oi 
















diiferent words 


1604 1108 


1248 


1887 


1457 


1585 


1685 


1010 


Number of words 
















common to sll ten 
















readers 


410 410 


410 


410 


410 


410 


410 


410 


Number of words 
















not found in Aldine 


521 


608 


681 


646 


677 


008 


006 


Number of words 
















found in Aldine 


677 


681 


756 


811 


858 


750 


014 



TABLE VI 

▲ THZBD lOffHOD BBADMB (BBAOOV) OOMPABBD WITH 8BVBN OONTBMT BBADBB8 VOB THB 

PUBP08B OP mJ0€IB8TINa 8UPPLBXBHTABT MATBBIAIi 





Beaoon 


Oyr 


Heath 


Gordon 


Biyer- 
side 


BAB 


New Ed. 


Elson 


Total number of 


















diiferent words 


1468 


1108 


1284 


1878 


1457 


1585 


1658 


1010 


Number of words 


















common to all 


410 


410 


410 


410 


410 


410 


410 


410 


Number of words 


















not found in Beaoon 




548 


571 


602 


740 


782 


086 


1066 




















found in Beaoon 




655 


718 


605 


708 


758 


672 


844 



CONCLUSIONS 

1. A critical analysis of the vocabularies of a series of readers 
seems to give a measure of their value. 

2. Such an analysis will aid in selecting supplementary read- 
ers for use in connection with a given basic text. 

3. The readers present in the second grade quite different 
lists of words. Of the thousands of words in the ten readers, only 
419 are common to all ten, while when a 'method' reader and a 
'content' reader are compared, the number of words common to the 
two books is still relatively small, ranging only from 655 to 928 
words. 

4. Hundreds of the words'used in each reader occur only once, 
twice or thrice in that reader, thus failing to develop drill on these 
words. 



CHAPTER V 

COMPOSITION STANDARDS IN THE ELEMENTARY 

SCHOOL, ARRANGED TO SHOW THE MIN- 

IMAL PERFORMANCE ESSENTIAL 

IN GRADES TWO TO EIGHT 



JAMES FLEMING HOSIC 
Head of the Department of English, Chicago Normal College 



About two years ago the teachers of the Parker Practice School, 
which is one of the elementary schools connected with the Chicago 
Normal College, agreed to undertake to select compositions for each 
of the grades from the second to the eighth which should serve the 
purpose of standards of attainment for those grades. It was agreed 
that the type of compositions should be written narrative from ex- 
perience, this being the easiest, most popular, and most natural 
type of writing for children in the grades. If the work proved 
successful, it was hoped that other types might be standardized in 
like manner. 

Each child was permitted to select his owti subject. The pa- 
pers were written in school during a regular school period with no 
help from the teacher. 

Prom the papers written by each class the teacher in charge 
chose ten, classified as follows: two regarded as excellent, graded 
E; two good in thought and good in form graded 6. 6.; two, good in 
thought and poor in form, graded <?. P.; two, poor in thought and 
good in form, graded P. (?.; and two, fair or passing, graded F, 
No marks were placed on the papers, however, by the room teacher. 

Committees for choosing the final standards were formed by 
grouping all of the teachers from three grades to select the standards 
for the middle grade of the three represented. For example, the 
standards for the fourth grade were selected by a committee com- 
posed of all the teachers of the third, fourth, and fifth prrades. 
The object of this was to secure a certain uniformity of judgment 

46 
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by planning so that a majority of the same persons should engage 
in the task of judging the work of two consecutive grades. 

When the committees came to consider the collection of papers 
that were marked excellent, the number of which from each grade 
varied from six to ten, it was found advisable to make another 
grouping not asked for in the original plan. This group was desig- 
nated superior, and graded S. It comprised themes that showed 
something more in the handling of material than the average E 
paper. These superior compositions were included in the scale to 
show what will be done by exceptional pupils or by ordinary pupils 
in exceptional circumstances. It is a matter of regret that the 
committee did not see fit to include compositions representing the 
lower degrees of performance as well. It was not the intention, 
however, to produce a composition scale in the strict sense, but 
merely a collection of compositions which should serve the purpose 
of establishing standards of relative exactness for each of the 
grades. In actual use it was thought that compositions not so good 
as the passing compositions of the standards would simply be 
marked 'poor' without attempt to establish their actual merit. 

About thirty papers from each grade were marked by each 
member of the committee appointed to select the standard of that 
grade. These compositions with their marks were then turned over 
to a reviewing committee, composed of Elizabeth Blish, CJuUrman, 
Mary Bonfield, Lillian G. Baldwin, Sadie Phillips, Emma B. Lowell, 
and May L. Edwards, who read the papers, considered the marks, 
and finally selected in conference one typical example to represent 
each mark. In this way a series of five or six compositions was 
chosen for each grade of the elementary school, beginning with the 
second, as will be seen by reference to the specimens which follow. 
The members of the reviewing committee felt that the fair, or just 
passing, papers were more satisfactory as standards than any of the 
others. The progress from grade to grade in the case of these papers 
seemed gradual. The superior and the excellent papers, however, 
presented a much wider range of excellence, which seemed to be due 
to unusual children, or possibly to unusual experiences of some chil- 
dren. It was fairly clear that some of the superior compositions 
were due to the extraordinary circumstances through which the 
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diild had passed, rather than to any extraordinary ability on his 
part So far as the standards have been tested in classes of stadents 
eonsidering the subject of teaching English, it appears that there is 
a fairly gradual progress from Grade II to Grade VI. Above this, 
however, those who have attempted to evaluate the standards have 
had difficulty. It is doubtful whether there is any clear progress 
above the sixth grade. If this should prove to be the case, it 
would be one additional argument for the reorganization of the 
English work of the seventh and eighth grades. 

It will be noted that the committee of teachers made no use 
of a composition scale such as that devised by Professors Hillegas 
and Thomdike, nor even of such mathematical compilations as were 
used in the case of the Harvard-Newton Scale. This would have 
been beside the point. What was done by these teachers repre- 
sents the possibilities in the ordinary elementary school where the 
work is done by a group of teachers working without the aid of 
statistical experts. That very great value results from such at- 
tempt at standardizing, no one who has had contact with it can 
doubt. In contrast with the composition standards recently pub- 
lished by the Board of Education of the City of Detroit, these re- 
sults are doubtless relatively inaccurate, for in that case the persons 
who graded the compositions had trained themselves by an exten- 
sive period of use of the Hillegas Scale. So far as the present writer 
has tested the abilities of ordinary teachers to grade compositions 
by means of the scale, his results accord with those of Eelley as 
announced in his ' ' Teachers' Marks. ' ' While the extreme variation 
of the grades given with the help of the scale is less than those given 
without it, the median variation is even greater. This signifies that 
in order to work out standards in the elementary school with the 
help of the scale, it would be necessary to train a committee as 
was done in the case of the Detroit investigation. 

One of the most interesting points in the work of the Parker 
teachers is their attempt to select compositions good in form and 
poor in thought and the reverse. It will be noted that in some cases 
it was not possible to find examples of these sorts. Such composi- 
tions do exist, however, and their presence suggests the futility of 
attempting to assign grades to school compositions without consid- 
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ering content and literary form as contrasted with conventional 
usages in spelling, capitalization, punctuation, and grammar. It 
is probable that those who grade by means of the Hillegas Scale are 
led ultimately to ignore all such elements of composition as are 
not represented in that scale. This, to be sure, may result in a cer- 
tain superficial uniformity, but it is decidedly objectionable from 
the standpoint of class work. Of course, it is generally conceded 
that the use of such a scale should be in supervision and not in 
teaching. 

Composition Standards by Gbadxs 

QBADl n 

S 

I went to Jackson Park yesterday. I picked up a whole lot of little shellB. 
I found a shell that was shut and I opened it and there was nothing in it. 



Yesterday I played paper dolls with my sister. We had lots of fun. Then we 
had lundb. After lunch we played paper dolls again. Then my big cousin 
came from college. We got her to make some dresses for our paper dolls. 
After she was done we played jacks 

G.P. 

Yesterday I played with a girl 

We went to get my jumping rope 

On the way up the steps we found a baby kitten 

He was hungry 

We gave him some milk 

Then we took him bake to the place where we found him 

Then I went in the house and my supper 

G G 

Yest I went to church. It was childrens Day. The boys and girls spoke and 
sang. I went up on the platform and sang a song. The children were happy 

P G 

(Missing) 

F 

My father took me to the woods. I picked pretty flowers. 

GBADX m 

S 

The Bobins 

Last summer I was playing and I saw a nest. I went home and told my 
mother. Then my mother and I went down to where the robins nest was. 
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And we saw two robiiiB go to the nest One day we bought some food for them 
and the next day it was gone. One day we went to see them and they were 
gone. Then we waited a couple of days to see if they wonld come baek and 
they didn't. So we took the nest home. 

B 

My Experience 

When I was two or three years old I went with my mother and father 
on a fishing trip. When we got there we had to sleep on the ground with 
blankets. My dady conght a little fish and gave it to me but I was not big 
enough to hold it so I let it go. When we went home there was a hoot oin 
and I was afried of it and hid under the covers. 

GP 

The Wreck 

When I was out at my grandmother 's she to my sister and I to go for the 
paper so we went up to the station and then we heard a loud wist but we did not 
what it ment so we went on after a while to trains bumped togather and many 
people were hurt with broken arms and legs. The Biverside station was bnte 
a tiie side and we had to go away to to a little store by the river and my grand- 
mother asked us what kepd us so long and we told her what happen. The next 
morning the trains were running. I was surprize to see the trains running 

00 

My Garden 

A half of Saturday I was making my garden. I took a shovel and dug 
the dart up. Then 1 too the rake and raked the dry grass away. Then I 
got som soda and put it in the garden. Do you want to know what I put in 
my garden f I have put into my garden, radidies, geraniums, panseys, tulips, 
lettuce, and beans. I hope they grow. If they do I will bring a bunch of 
flowers to schooL 

PO 

(Missing) 

F 

On Easter 

On Easter I went to my friends house. We had Easter candy and we had 
some colored eggs. We had some eggs for supper. Then my sister and I 
went out to play. We had a good time on Easter. 

(SBADX IV 

a 

An Incident of My life 

Once when I was about two years old something happened to me. It 
was when I lived in East St Louis. We have a great many chickens at the 
time. My mother was out feeding them and I was on a box by the window 
watching. All of a sudden the ^x slipped and my nose landed on a naiL 
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That is how I got the scar on my nose. It looks something like a horse shoe 
and I have always had good luck after that. 

S 

When I Was Operated On 

When I was going to the Englewood hospital my father came and took me 
there. Then a nurse came and took me out of the auto and took me to a 
little room then I had to wait about three hours for the doctor. The funny 
part was that I was not sick at all sick when I got to the hospital but they 
made me sick. The doctor came with four nurses to get me. He had a long bed 
on wheels and he put me on it. Then he brought me to the operating room. 
Then they layed me on a long bed. Everybody in the operating room had 
white on. Then a nurse brought a little can of ether and put me to sleep. 

OP 

(Ififldng) 

O O 

An From a Little Match 

One day when Llewelyn and I were up at his house Llewelyn lighted 
a match we were but babies and he threw it in the wastepaper basket It 
was not much of a fire but it could have done a great deal of damage to the 
flat Llewelyn lived in. Llewelyn screamed as hard as he could and Esther 
came running in and she screamed to. Then Mrs Abbott came running in and 
threw some water on the fire. Then my grandmother came and took me home 
and I had a big spanking. 

PO 

My Experiences on the Farm 

During moving week I went down to Mattoon, Illinois, and stayed all 
week. On ^ursday I went to the country and stayed until Saturday afternoon. 
I had a very nice time, too. Friday liielma and I went out to the chicken 
farm and they have an old turkey gobbler of which I was afraid because he 
acted so proud that he scared me badly. But I had a very nice time. 

F 

On the Farm. 

When I go to my grandpa's I feed the horses and the chickens. I like 
to feed the pids to. I liked to go to the hay field with the hayers. It is such fun 
to sit on tiie hay stack. 

GBADI ▼ 

8 

Our Phonograph 

We have a phonograph in our home, near a window. I am very interested 
in it. Sometimes I devote as much as one half hour playing and listening 
to it. All of my friends and also my family enjoy this little pb>nograph. 
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One day while I was playing my favorite record, as I was taking it off 
it broke. I was so sorry, I couldn't be cheered up until I had another of tlie 
same song. I went to several stores but I couldn't find the same kind. Tlie 
week after that my fother surprised me with the same song. We have numj 
other records, but none as sweet as this. 

One morning when I woke up I found a new record. It was quite early in 
the morning. ThLi was sweeter than any other record I had ever heard. I 
woke my mother up and said to her, "Isn't this record large f It is just beaa- 
tifuL" After I had finished playing it» she said ''Ton are getting to like that 
phonograph too much." 

Then she went away, leaving me much excited. I think a phonograph is 
is wonderfuL It is just made out of medal and sounds so human. 



A Horse Back Bide. 

One day I asked my father if I could go horse back riding, and he said, 
"Yes, if you know how to drive the horse". I said I knew and went to tho 
bam. At first I saw no one to saddle the horse, but afterwards I saw one of tho 
darkies called Archie. I said to him, "Archie I, will you saddle the horse for 
me", and he said, "Certainly I will." So he saddled the horse for me and 
put me on the horse. I had not gone far when I came to a place with lots of 
green grass. I thought the horse was hungry and I let him eat, but when I 
went to pull him away he would not let me. I pulled so hard that I lost the 
reins and had to get down although I did not how to get upon the horse again. 
I got the reins over the horse's head, and pulled him up by the fence. He 
would not stand still long enough for me to get on his bMk. After a while I 
got tired of standing there so I pulled him up again and got him to eating. 
While he was eating I got on his back and rode on my way. I did not let him 
eat any more grass. 

QF 

A Boy Scout Hike 

Holigan, Bab, Edgar and I went on a boy scout hike. We were going to 
summit. When we got there it was twelve o'clock. We were all hungry, 
so we decided to cook dinner. Bab said, "That he and Edgar would build 
a fire if we got some wood. After dinner we started out to see what we could 
find. We were but a Uttle ways when Edgar saw a snake. We let the snake 
alone and went on. After wMle I saw a big mud turtle. He was about a 
foot wide. We took him and threw him in the water. It started to rain after 
we were out there for about four hours. When it stopped raining we ate sup- 
per. After supper we were sitting around our fire. Edgar started to running. 
We did not know what he was running after. Then we saw a little rabbit 
running in front of him. 

QG 

My Walk to Beverly Hills. 

Sunday my mother, my brother, my father and myself took a walk to 
Beverly Hills. My father said, "You and Daniel go walk along the sides 
and maybe you wUl find some violets. We walked iJong the side and found 
many violets. After we were between Beverly Hills and Longwood my father 
saw a green house it looked something like a chicken coop, '^^en we got there 
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we found it a place were a man lived. As we passed through the country 
we saw fields of violets. 

We came to country school house about as big as a school room. Every- 
thing was curious to us, but if they came to where we lived they would think 
the same. 

PO 

(Missing) 



In the Country 

I went to the country and had a very nice time. It was raining when I 
got there and it was very muddy but I had my rubber boots along so I put 
them on and went to our cottage. I got my rain coat and went to the bam* 
I started to milk. Then I went to my uncle 's and stayed over night till Sunday. 
Then we went back to our farm. 

OBASB Yl 
8 



(Missing) 



An Incident on Horseback 



About two years ago this summer I was on a farm in New York State. 
It was near the vUlage of Jay. The people we were staying with kept a board- 
ing house as well as the farm. 

They had six horses, two buggy horses and four truck horses. I rode 
horseback on the smallest buggy horse. One day when I was horseback riding 
the dog (which belonged to the lady with whom we were staying) began to 
snap and bark at the horse. This got him nervous so in order not to be thrown 
I steered him around in a circle. The dog sat in the middle looking at us 
every minute but before long he got so dizzy that he could not get up. I 
thought we could get away before he recovered but I was entirely mistaken 
for when I pulled on the other rein the horse would not turn. We kept on 
in a circle until the hired man who happened to be in the yard came and took the 
dog away. I then stopped the horse. 

You may be sure I did not ride around the dogs again. 

OP 

Learning to Bide a Byeycle 

One day a girl friend of mine came over to my house. She brought her 
bycyele with her. I asked her if she would let me try to ride it, and she said, 
"Yes." I got on the bycyele and she held it up. It was rather hard for me 
to reach the pedals, but I managed to do it. I wanted to try to ride alone, 
but she said I might fall off. Just the same I would try to ride alone. 
I tryed to go alone but I could not. I would have fallen off if she had not 
been right along side of me. I rode along with her for a while, but I wanted 
to try to ride alone again because I wanted to show another girl friend of 
mine that I could ride a bycyele. Just as she let go of the bycyde I fell over 
onto the curbing and knocked one of my loose teeth out that I was glad to get 
rid of. I had a nice time but I will never try to lide a bycyde alone again. 



54 THE aEVENTEENTH YEARBOOK 

GG 

A Boat Trip 

Last sommer I went to Milwaukee on a steanahip. We left down town at 
about nine o 'clock A. M. We had a very good time on the boat. At noon time 
it was fun throwing crusts of bread into the water and watch the birds get 
it. We got in Milwaukee at two or three o 'clock P. M. We hired a taxi and 
saw some of Milwaukee. In about an hour the ship was ready to sail back. 
When it was dark it was fun sitting on deck. We pretend when ships came 
behind us that they were pirate ships and we were trying to escape. We 
landed at about nine o 'clock P. M. When we got home I was so tired I slept 
till about non the next day. 

TG 

What I Did Between Friday and Monday 

Friday night I went to the. Harvard Photoplay House, to see, ''Little 
Mary Sunshine". It was very good. 

Saturday I read and played with some girls. The name of the book I 
read was, "Bebecca Mary". In the evening I went out with my father and 
Mother. 

Sunday I read some more and went away in the evening. When I first 
started out Sunday it began raining so I had to wait until it stepped. 

Monday I went to school as usual. That afternoon I played out doors 
with some girls. In the evening I did my studying and then went to bed. 

F 

Setting the Backkitchen Afire 

When I was a little boy I liked to play with fire, so one day I thought 
I would bum the papers, that were in the basket. It happened that the basket 
was full, so I went into the kitchen and got some matdies. I did not bother 
to take the papers out into the alley, but set them afire right where they were. 
After I had them ablazing high. I went upstairs and told my mother that 
blachey set the papers afire. Blachey was our little cat, but my mother vras 
glad I told her. She called up the fire department. They got to our house 
about an hour later, and by that time a boy had the fire out with our garden 
hose. 

GRADB vn 

a 

A Dissapointing Hike 

Saturday I had a very funny but dissapointing thing happen to me. 
There were three girls and three boys altogether and we started out about 
noon with our lunches for some woods near Morgan Park. When we were 
about half way there it began to rain but we trudged on thinking that it 
would stop pretty soon. But oh no! It kept right on raining harder and 
harder every minute. I felt as if my shoes were half full of water and my 
sweater was dripping wet. My hat had red poppies around it and red water 
kept continually dripping off the brim of my hat. My shoes were covered with 
black mud and my hands were wet and cold. Finally we got into the woods 
which were not very thick and which didn't shelter us much. One of the 
boys built a fire, out of some dry wood that he chopped out of the inside of a 
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logy 80 tliat we could get dry and warm and eat our lunch. The fire was very 
amaU but it was better than nothing so we took our lunches out and began to 
eat. We were all a droU looking sight. I couldn't see myself but I imagine 
I looked even funnier than they did, standing there beside the tiny fire eat- 
ing very fast to keep my food from getting wet and red water dripping on 
the ground and down my nedi from my hat. Finally after vainly trying to get 
dry we started home. Later, when I was sitting next to the warm stove with 
a cup of hot tea inside me I breathed a sigh of relief and thought ''Home^ 
Sweet Home." 



My First Bide on the Street Car Alone 

My most interesting experience was my first ride on the street car alone. 
I was nine years old and I was going to see one of my girl friends who lived 
on sixty-fiftii and Kimbark Avenue. I was going to take my doll with me 
and I had a great deal of trouble getting it dressed just so. It was at the time 
when they had open cars in the summer. I could find no place to sit but up 
hi front with the moterman. When the conductor came up to collect my fare 
he said, "Well, who is thisf " I did not answer him at first until he asked me 
what my name was. Then he saw my doll and said, "Ohl you have a baby 
witii you. Well I guess I will have to charge you c^ra for it." I was be- 
ginning to get frightened at that but to change the subject I told him to let 
me off at Kimbark Avenue. The moterman turned around and said, "I will 
take care of her, but you had better go and finish coUecting your fares. ' ' After 
the conductor was gone the moterman started to talk to me in spite of the sign 
above his head wUch said, "Motermen must not talk to passengers." He 
naked me where I was going and if my doll was ever sick. Every once in a 
while he turned around and said, "I thhik I hear your doU crying." 

I was glad when we came to Kimbark Avenue because I £d not like to 
have everybody asking me questions. When the conductor lifted me off the 
car I found my friend waiting for me. When I told her what had happened 
in the car she laughed and I could not imagine why. 

GP 

A Thrilling Experience on Lake Michigan 

It was a windy and stormy day in October. My Sister Mother and I 
were up in Manistee Mich. We had been there all summer and were now 
anxious to come home. We telephoned the lighthouse to see if the water was 
rough. We found out that it was very rough and foggy. We were i^ very 
anxious to go hcxne and so we telephoned the Ugh&ouse once more. The 
water was not quite so rough this time and so we thought we would go anyway. 
We set sail that evening at about 6. o 'clock. As soon as we reached the lake 
the ship rolled and tossed like a cradle. The wind blew like a cyclone wind. 
We finally decided to go to bed. The captain came along and offered to help 
US to our state room. My mother was leang on the wall outside of the state 
room when the ship gave a sudden lurch and the door slammed shut on her 
thumb. When the captain brought her in she had fainted. A matron came 
with some ice, but it did not do much good because her thumb was broken. 
Ohl how sick we were could not be explained. I hdpe never to have an ex- 
perience like that again altho it might have been worse. The captain said 
an the dishes were broken and that the second deck dipped water. 
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00 

VfhBt DiBobedienee Did 

It was in spring vaeation and there was a building being pnt up at tlie 
eomer of Sixtj Seventh and Pamell Ayenne. Ererj evening after the men 
went home some of my friends and I played tag on the elevator. Mj mother 
told me not to play there for I woold get hnrt. The evening after my mother 
told me not to play on the building the boys begged me to eome and pli^. 
After a idiile I said I wonld knowing all the time that I was disob^in^ 
I was up on the third floor "which was the roof" running as fast as X 
could to get to the elevator and slide down the rope. When I got to the ele- 
vator I jumped for the rope but missed. I went down, down, down and I 
didn't think I was ever going to land when I stopped with a jerk. A little 
idule later I was surrounded with boys and was being brought home on my 
two brother's shoulders. When I got home my motto was so mad that I 
got a Ucking besides a gash in my leg from the f aU. I think I had a good 
l»BSon for dbobeying orders. 

PO 

A Disappointment 

The most disappointing experience that I can remember, is when I went 
to Bavina Park and sat on the pier all afternoon with a line and never caught 
any flsh. 

We started for Bavina Park at ten o'clock and got there about twelve 
o'clock. As soon as we got into the paik my sister sai^ "O let's have some- 
thing to eat. ' ' 

I said; ' ' I second the motion ' '. But mother wanted to stay in the park 
for a little while, so we stayed in the park until half past twelve. When it 
was half past twelve, brother said, ' ' Ah, the stroke of half past twelve. ' ' 

We picked up our lunch and the wraps we carried and started for the 
beach. The beach was about a mile from the park so we had a long walk. 

When we got to the beach we built a flre and made some coffee. After 
dinner mama, Evelyn, and Papa and Myrtle went to the concert. 

Brother got the lines ready and put the bait on them. He gave me a line 
and said, "Sit still now or you 11 scare the fish." I was perfectly disgusted 
to think that brother didn't think that I knew enough to sit still when I was 
fishing. 

I sat and sat, but nothing bit at the bait. Finally I got tired and told 
brother I was going down to get a cookie. Brother held my line for me until 
I got back, but then I had to teke it again. 

It was three o'clock before the folks got back and I hadn't caught a 
fish. 

F 

Catching Turtles 

Last summer another boy and I went to catch turtles. We rowed to a 
place where there was some. Pretty soon we saw some on a log. I rowed the 
boat slowly up to where they were sitting, then I gave a lunge forward and 
pushed the oars with all my might. At &e same time off jumped the turtles 
into the water. They swam under the weeds, and sea-grass, I grabed the oar 
and fished three of them out and almost tiped the boat over beddes. We got 
them aU right and put them in the boat. Two of them were snapping turtles 
and one was not. ^nie latter had a shell and all colors. We took them baek to 
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tbe cottage and played with them for a while, and then we put them in the 
lake. 

a 

A Daring Leap 

While down town^ walking up State Street a short time ago with Mother, 
I saw a man narrowly escape deatii. We had jnst reached the north side of a 
crossing where the traffic was controlled by a policeman, when I happened to 
look up the street. For a wonder, it was fairly dear of automobiles and other 
traffic Suddenly, I was attracted by a red and yellow racer, coming toward 
me at a fast clip. 

When the racer was about a block away, a loud report came from it. 
Also, a cloud of smoke which completely enveloped the striped automobile. 
Out of the smoke shot the speeder, coming on at a dangerous rate. The 
thing came nearer and nearer to the crossing. Would it reach there before 
the whistle blewf As the policeman was busy, he had not seen the fast 
approaching speed-demon. Then the whistle blew and directiy into the path 
of the racer, lumbered a big, heavy, auto truck. The car was no only a hun- 
dred feet away and the driver, a young man, was fumbling with tiie steering 
gear. The glunpse I had of ms grim face showed no signs of fear, sJthoug^ 
it was a chtJky white. Quickly, the driver slid from his seat to the running 
board poised himself for a second and then jumped. 

Not a second too soon, for the next instant the car crashed into the big 
truck. Bang! went the gasoline tank, and when the smoke cleared, the racing 
automobile was scraps and the truck badly damaged. The man had luckily 
fallen into a clear space but did not move. Evidently, he was badly hurt. Up 
came the policeman in charge of the street and carried him to the sidewalk. 

A man in a store nearby had telephoned for the ambulance, so in about 
five minutes, the injured man was on his way to the hospitaL Mother and 
I then went on. 

The only way that I can account for the accident is that he had broken 
both his brakes and steering wheel at the time of the car being surrounded 
by smoke. Beally, I do not care to see such a thing again. 

E 
Breaking a Door Glass 

Young as I was, I was very fond of marbles, especially those brown, hard 
ones that were six for a cent. I was always usmg them when I should have 
them put away. It was one Sunday, when I was told to put them away, that I 
disobeyed, and took them with me to a friend's house. 

It was great sport, throwing my marbles against the stone stairs and 
eatching them as they bounced back to me. But my fun was soon spoiled by a 
marble which went too high and broke the large, engraved, plate glass door that 
led from the porch into the house. My mother was summoned and I was told, 
in fact I knew very well, what would happen when I got home. As I was very 
small, I threw the marble into a sewre thinking that would help matters but it 
did not. This combination of pleasure and misfortune cost my father thirteen 
dollars and a half. 

GF 

A Night in the Swamp 

One day, my chum and I did not have anything to do so we decided to 
go out on the swamps which were about a mile ^m my house with our twenty 
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two's sad look for m ui k n U a sad otter aiBall gUM. We itartad about kalf 
post twidro or OMO 'dock iatkeafterBooB. Mj ekom ksd Ms IriA Mttcr with 
kim sad we ■ittifipoted a goo dtim e. As tke afiemooa adraaeed we got furtker 
aad fMiiher iato tke swamp aad we kad aot yet raised aa j gaaie exeeept one 
■niskrat wkidi we botk ilied at aad botk au^sed. About six odoek we weie 
tea allies from kooieaad aigkt was iwiiag oafsst. 

We qoiekl J toraed arooad aad started oa tke ma for koaie^ We kad 
goae about a kalf adle wkea we soddealj aiisBed aij ekam's dog. We called 
aad called bot ke did aot come. My ckam said, * ' I tkiak ke aiost kare been 
cao^^ ia a BioMkrat tr^. We kad better go ba^ aad look for kiaL" So we 
turned around aad weat bade We seareked for over aa koor before ke was 
fooad. It was just ss we kad tkongbt Tke ke was witk bott kiad feet ia. a 
tr^ aad it ainst kaye knrt kim because ke was wkimporiag. Wkea ke was 
released ke ooold kardlj walk. We agaia started aad kad to go Yerj 
slowlj on sceoont of tke dog. It was eij^t odoek aad we were still sevea or 
ei^^ miles from bome. We walked on aad after akat seemed ages we came 
to tke ton gate, wkick was a lift bridge over a smaD riTer. ^it to oar dismay 
tke bridge was up for tke ai^ aad tbere was ao Uglit in tke ke^ers knt. We 
yelled and tkrew stones but it seemed tbat tke toll keeper kad gone to town. 
We locked for a boat but tkey were all on tke otker side of tke rirer iHiere all 
tke people lived. At deven odoek tke man iHio tended tke bridge came bome 
aad we got aeroes. We did not kave any toll money and ss ke fdt sorry 
for OS ke let us aeroes free. We ran like ererytking and were soon kome. It 
was twelve odoek wken we got kome but nobody was komei Tkey were all out 
looking for us. At two odoek tkey came kome. Tkey tkeu^t we kad gone 
on to the next town until the man at tke bridge told tkem ke ^d seen as going 
towards borne. Tkey were so glad to see us Okej forgot to scold and we got of 
free. But we dedded or ratte' our parents dedded the next tkat we would 
never go into the swamp without a grown up person with us. 

QQ 

A Snake Hunt 

Two years ago in the southern part of Illinois, my cousin and I went 
snake hunting. He had a golf -stick and a knife and I had a small pistoL 
With this equipment we started to a large pond on my IJnde 's farm. Into this 
pond flowed a small creek, so we followed it for at least an hour and had not 
seen a snake. I wanted to go back home but he wanted to go on a while longer 
so I went with him. 

We walked and watched for snakes until we saw one which we killed. 
Then we happened to take notice of our whereabouts and we dedded to start 
home for it was getting dark. 

So we started home on the run, but it soon became so dark we could not 
see the creek any longer, we had to wade in the water to know where we were 
going. It took us alK>ut an hour and a half to get home where we ate a big 
supper and then we told our story and which made everyone laugh and tease 
us about not knowing enough to come home when it started to get dark. That 
experience made us not want another snake hunt. 

PO 

Locked Out for the Evening 

One afternoon as I was playing with a friend of mine in the house, we 
dedded to go outside and play. When I came from school I had my coat on 
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and the kej in my pocket, but as it waa wanner now than it had been I pnt on 
my sweater. 

"Come on," I said to my friend. At this we both ran thoughtlessly oat 
of the door and just as it dosed I ezdaimed ''What will we dof I left the 
key in my coat pocket. It is mother's key and papa will not get home until 
half past nine. " 

"Well you're a great one. But accidents will happen." 

We went to the back door to see if any window might be open or any 
possible way of getting into the house could be found. But alas I All the 
windows were down. 

"Mother is coming on the elevated so 111 go and tell her the sad news," 
I said. 

"(Goodbye then I hope everything turns out all right," was my friends 
parting reply. 

"I do too," I answered. 

Then just as I left her it began to rain, and it came faster and faster 
until it was really storming. At the station I waited and waited and at last 
my aunt appeared, but not my mother. 

"Where is mothert" I questioned. 

' ' She went home early because she had a bad head-ache. Why are you 
here!" 

"OI We're locked out and mother has a head-ache," I exclaimed. 

' ' I knew this would happen sometime when you had the key, but come on 
over home with me and your mother can lie down, ' ' my aunt said. 

' ' That surely is a relief, ' ' I said with a sigh of relief. 

Of course this wasn 't a nice situation but it was better than being in the 
rain until nine thirty, for we went to our house and found mother on the steps 
and then went to my aunt's for the evening. 

F 

A Lesson; That I Learned When I Was Small 

I had gotten my experience by handling a razor without permission. My 
father generally puts his razor away every time he uses it, but that day he left 
it on the window sill. I took it out of the case and examined it. After turning 
the blade around several times, it cut through the skin of my finger, quite deep. 
The blood started to circulate very rapidly. I certainly knew enough to leave 
razors alone after that. 



CHAPTER VI 

A SUMMARY OF TEN RECENT INVESTIGATIONS IN THE 

FIELD OF ENGLISH 



Prepared under the direction of James Fleming Hosic, Chicago Normal College. 



Breed, Frederick S. and Frostic, S. W., Measuring English compositioiL in the 
sixth grade. Elementary School Journal, 17 : January, 1917, 907. 

Four hundred eighty-one samples of English composition on the same 
subject were written under relativelj similar conditions. Three competent 
judges graded these compositions independently into ten groups. The samples 
were then arranged in such manner that the poorest spedmens were placed in 
Group one, the next to the poorest in Group two, and so on to the best group, 
which was marked ten. The reports of the three judges were then tabulated 
and a set of seventy samples chosen for further investigation. The scale was 
constructed by selecting from the seventy samples in a manner similar to that 
employed by Professors Thomdike and Hillegas. 

Courtis, 8. A. and Beverley, Clara, English Composition, Detroit: Board of 
Education. Pp. 158. 

A volume of compositions illustrating the written work of the children 
in the Detroit elemental schools. The compositions were evaluated with the 
help of tiie Hillegas Scale by a committee specially trained for the purpoee. 
This committee was made up of the supervisor of English in the grades, MisB 
Clara Beverley, and the supervisor of educational research, Mr. 8. A. CourtiSy 
together with Mr. Courtis' assistants. Among the other material in the volume 
is a scale evaluated in the terms of the Hillegas 8cale and also in terms of the 
teacher's mark for the grade. 8et ''J" of l£e Thomdike collection of En^^iah 
compositions for practice is reproduced entire, together with the values in terms 
of the Hillegas 8cale. The supply of the pamphlet is limited. Those interested 
should correspond with Miss Clfura Beverley, OfSce of the Superintendent of 
Schools, Detroit, Michigan. 

Diebel^ Amelia and Sears, Isabel, A study of the common mistakes in pupils' 
written English. Elementary School Journal, 18 : November, 1917, 172. 
This study should be compared with a similar one made upon the oral 
English of exactly the same number of pupils in the same grades of the same 
schools in Cincinnati, and reported in the Elementary School Journal for Sep- 
tember, 1916. The authors state that ^^the main question in the teaching of 
written English, as revealed in the papers examined, is not so much one of the 
use of language as of punctuation, composition form, and carelessness — ^these 
three items supply 66 percent of all the mistakes made." 

Haggerty, M. E., Measurement and diagnosis as aids to supervision. Sciuwl 
and Society, 6: September 8, 1917, 271. 

This study represents an attempt to follow the progress of certain ele- 
mentary pupils by means of the Hillegas and Harvard-Newton composition 

60 
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sealee. Approximately 300 diildreii, eight principalSy and as many teadien 
were eoneeriied in the investigation. No definite conclusions are drawn, except 
that more accurate scientific methods are needed in sapervision than we have 
been employing. ,, : J Sjjj 

Johnson, Boy Ivan, The persistency of error in English composition. School 
Beview, 25: October, 1917, 553. 

This reports an investigation carried on in the Junior College of Kansas 
City. It is listed in the present connection because of the fact that it is an 
aftermath of the work carried on by Professor Charters and reported at length 
in the Sixteenth Yearbook, Part I, Mr. Johnson draws the conclusions that it 
is necessary to take into account both persistency and prevalence in determining 
the order of needed increase of emphaisis in the teaching of correctness. This, 
he thinks, may be done by making a ranking of the sums of the ranks of each 
class of error in persistency and prevalence. He believes that there is very 
much greater need than is realized of drill in the mechanics of writing to 
bring about habitual accuracy. The decrease in ungranmiatical sentence struc- 
ture, mistakes in the case of pronouns, and misspelling is highly gratifying. 
There is also marked increase in ability shown by the college freshmen in the 
handling of ''the more difficult forms of discourse — description and exposi- 
tion. ' ' This increase of ability may be dependent somewhat upon the natural 
increase in maturity of thought power. 

Mahoney, John J., Standards in English — A Course of Study in Oral and Writ- 
ten English. School Efficiency Monographs. Yonkers-on-Hudson : 
World Book Co., 1917. Pp. 198. $ .90. 

This monograph is of the same, character as Sheridan's Speaking and 
Writing English, Indeed, the two men worked together for three years in the 
development of a set of standards and then publis^d their material separately. 
Of course the illustrative compositions, as well as the text, are widely different 
in detail. The two together constitute the most considerable contribution yet 
made to the problem of definite organization of oral and written composition 
work in the elementary school. Specific standards of attainment are set up for 
each grade and very helpful suggestions are made for reaching these attain- 
ments. No objective measurement, however, was used in determining the val- 
ues of the illustrative compositions. It will probably appear, when they are 
tested, tiiat there is considerable unevenness in the steps from ^mde to grade. 
Both volumes should be in the hands of all supervisors of English and, if pos- 
sible, in the hands of all teachers of the subject as welL 

Bandolph, Edgar D., Conventional aversions versus fundamental errors in 
spoken English, Pedagogical Seminary, 24 : September, 1917, 218. 

Thia investigation, carried on in the Speyer School of Teachers College, 
Columbia University, was previously reported by Professor Charters in tiie 
Sixteenth Yearhodk, Pari I. The article is listed here for the convenience of 
those who wish to examine the material at length. It is especially interesting 
because of the number of examples quoted with comments. What is needed is 
to eolleet a large body of actual work of children in order that sound eondusiona 
may be drawn. 

Sheridan, Bernard M., Speaking and Writing English, Chicago: Benjamin 
H. Sanborn ft Co. 1917. Pp. 162. 

"A course of study for the eight grades of the elementary school, with 
practical suggestions for teaching composition and a full set of compontion 
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standards." This is a revision of the pamphlet with the same title which was 
published by the Board of Education of Lawrence. Massachusetts, in October, 
1915. ' * Several new chapters have been added to Part I in the present edition. 
These, for the most part, are taken from the author's Suggesiiona for the Im- 
provement of Written Composition, published privately in January, 1917. Care- 
ful revision of other parts of the work has been made wherever the results of a 
thorough trial of the plan in Lawrence have seemed to justify it The num- 
ber of illustrative compositions has been considerably increased." (See 
ICahoney.) 

Thomdike, Edward L., Tests of esthetic appreciation, Journal of BduoaUonal 
Psychology, 10: November, 1916, 509. 

This article includes judgments of geometrical forms and judgments of 
verse. The essential feature in the latter consists in the appreciation of the 
quality of a line of poetry written to complete a couplet, the first line being 
given. In each case a line of poetry is completed in six different ways and 
the judges are asked to decide which is the best. The judgments are arranged 
so as to show the presumably correct order for each set of lines of poetry and 
the quality of some extra lines. 

Trabue, M. B., Supplementing the Hillegas Scale, Teachers College Beeord, 18 : 
January, 1917, 51. 

This scale is made up in part of compositions written in the course of a 
survey of the schools of Nassau County, Long Island, by the Department of 
Educational Administration of Teachers College in 1916. The upper end of the 
scale, however, is taken from the Hillegas Scale. The method of derivation is 
essentially that worked out by Professor Thomdike and Professor Hillegas, 
with variations which cannot be described in a brief review. Undoubtedly the 
scale represents a step forward in the rdlnement of the tool. Perhaps its most 
striking feature is a composition graded approximately at zero which was 
actually written by a school boy. 
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CHAPTER VII 

THE CONTENT OF THE COURSE OF STUDY IN CIVICS 



B. B. BASSETT 
State UniTersity of Iowa 



AIM 

In the following pages the writer will endeavor to set forth 
in a summary way the aim and method of an attempt to discover 
what shonld be the content of the course of study in civics, and the 
main results obtained. 

The investigation was undertaken with the conviction that 
the function of civic instruction is to prepare the pupil for citizen- 
ship in a democracy ; that such instruction implies preparation for 
the intelligent exercise of the elective franchise to the purpose that 
the voter will not be ''satisfied with merely going through the mo- 
tions of government" but tjiat "when he goes to the polls on elec- 
tion day, he will feel the thrill of executing an actual judgment;"^ 
that this result is to be obtained in part by the cultivation of civic 
judgment^ through the exercise of the mind upon concrete problems 
that confront the American electorate. The aim, therefore, of this 
investigation is to determine what are the most significant and most 
persistent problems of the American people which seek solution 
through the machinery of government. 

DATA 

The specialist in any line of work is most conversant with prob- 
lems peculiar to his own field of endeavor. For this reason, in seek- 
ing to ascertain what problems are of most value for educational 
purposes, the writer has consulted the specialist in politics, viz., 
the professional politician. 



*Woodrow Wilson— TAe New Freedom, p. 256 
'Arthur Dunn. — Community and the Ciiieen, p. zii. 
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In political platforms, state and national, have been preserved 
for us during a period of three quarters of a century-, the carefully 
formulated opinions of these politicians (and shall I say statesmen!) 
as to what our problems are. 

Walter E. Weyl says: **A platform does not show what the 
politician wants; but does show what that astute person believes 
that the people want. The superlative value of the platform as 
evidence is due to the fact that it is always addressed to a potential 
majority." 

DIVISIONS OF THE STUDY 

The writer has divided this study into the following parts: 
(1) an analysis of the national platforms of all the political parties 
since the first National Convention in the year 1832 ; (2) an anal- 
ysis of the state platforms in non-presidential years from 1889 to 
the present time so far as they deal with national issues; (3) an 
analysis of all state platforms of the major parties in one year 
(1910) ; (4) an analysis of the platforms of the major parties in 
certain selected states, viz., California, Indiana and New York, 
since 1850; (5) an analysis of all platforms of the parties in Iowa 
since 1889, and (6) an analysis of the platforms of one Southern 
State. 

The States of California, Indiana, and New York, were selected 
because they are or have been in national elections 'pivotal* states, 
in which, therefore, because the balance of power was uncertain, 
political interest was acute. 

Iowa represents a conservative republican state which has had 
but one Democratic governor (Governor Boies) and has but once 
gone Democratic on the presidential ticket (1912). A state from 
the 'solid South' would, of course, represent the conservative Dotio- 
cratic tendencies. 

METHOD OF ANALYSIS 

The units of measurement used were as follows: (1) The 
linear inch. This unit is entirely impartial and is justified upon the 
assumption that, given a sufficiently long period of time, the topics 
most discussed are most important. (2) Frequency of mention, 
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f. e., the number of platforms in which a given topic occurs. (3) 
Single platform proposal, i. e., the number of distinct proposals 
falling under each topic. These units will be illustrated by sample 
tables. 

Classification of Topics. It is evident that for purposes of 
comparison and evaluation the number of major topics in our clas- 
sification must be reasonably limited. It is equally dear that polit- 
ical proposals do fall into certain general classes; e. g., tariff, in- 
come tax, inheritance tax, poll tax, all come under 'taxation,' while 
taxation, national budget, national debt, etc., fall equally well under 
'public finance.' 

By trial, it was found that all political problems could be 
classified in the following twenty-six groups : 



1. Commeree, Foreign 

2. Corporations, Interstate 

3. Constitution 

4. Defence, National 

5. Education 

6. Finance, Public 

7. Foreign Belations 

8. Health 

9. Immigration 

10. Industry 

11. Justice 

12. Labor 

13. Legislation 



14. Monetary Syslmi 

15. Moral Beform 

16. Natural Besourees 

17. Office, Public 

18. Parties^ PoUtleal 

19. PensionB 

20. Personal Bights 

21. Postal Senriea 

22. State Bights 

23. Suffrage 

24. Territories (and Dependenetes) 

25. Works, Publie 

26. Miscellaneous 



The item 'Miscellaneous' includes only unimportant state- 
ments, such as preambles, conclusions, instructions to delegates, 
endorsements, principles, etc. 

In order that the further subdivisions of our groups may be 
better understood the following samples of the detailed classifica- 
tion of a few of the most important topics are inserted : 



6. Finance, Public 
A. Bevenue Beceipts 
a. Taxation 

(1) Indirect 

(a) Tariff 

(b) Excises 

(c) Inheritance Tax 

(d) Emergency Taxes 

(2) Direct 

(a) Property 
Beal 
Personal 



(b) Income 

Individual 
Corporate 
b. Credit 

Bond Issues 
c Proceeds of sale of Public 

Land 
d. Proceeds of Gk>vemment Bus- 
iness 
B. Management 

a. National Bank 

b. Treasury Department 
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C. AppropriatioiiB B. Appointive (Patronage) 

a. Budget C. Competitive (Civil Service Be- 

b. Economy form, Merit Sjstem) 

D. Debt, PubUc D. Qualificationa 

a. Repudiation E. Tenure 

b. Method of Payment F. Emoluments 
2. Corporations, Interstate G. Efficiency 

A. Transportation 15. Moral Beform 

a. Steamship A. Slavery — ^Negro 

b. Bailroads B. Liquor Traffic 

B. Communication C. Marital BelationB 

a. Telegraph a. Marriage 

b. Telephone b. Divorce 

C. Industrial (Trusts) c Polygamy 
17. Office, Public d. Social Evil 

A. Elective e. White Slave Traffic 

a. Registration D. Penal Beform 

b. Ballot a. Prisons 

c Corrupt Practices b. Capital Punishment 

(1) Bribery E. Charity 

(2) Fraud F. Sabbath 

G. Gambling 

The application of this method of classification to national 
platforms is shown in Table I, which reads (taking corporations as 
a sample) as follows: * Corporations' ranked third in the total 
number of linear inches — 370 — during the year 1900. Some men- 
tion was made of this topic in six of the seven platforms. Of the to- 
tal amount, the Democratic party devoted 142 linear inches (102+ 
22+18) of a total of 861 : the Republican party 30 linear inches 
of a total of 895; the Prohibition, none: the People's party, 81 
linear inches of a total of 546; the Socialist Labor, 24 linear 
inches of a total of 176 ; the Middle of the Road party, 26 linear 
inches of a total of 146 ; and the Silver Republican party, 67 linear 
inches of a total of 621. All other topics may be read in the same 
manner. 

Table II illustrates the same method of classification applied 
to state platforms and is interpreted in the same way. 

Table III illustrates the application of the * single platform pro- 
posal' as a unit of measurement. The table shows that there were 
twenty-two Democratic, and nineteen Republican proposals, or a 
total of forty-one proposals, with reference to corporations gener- 
ally ; of this number, there were four Democratic and two Republi- 
can proposals to abolish trusts, a total of six ; of this number two 
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Democratic platforms favored "effective anti-trust laws," one com- 
mended the State's anti-tniBt law, and one tti^ed the "abolition of 
the Smelter Trust, " etc. The grand total ahowa that there were 
561 platform proposals made with referenec to corporations. 
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Labor (8-Lab) ; Middle^f-the-Boad (H-B) ; SilTSr B«pubticaii (S-B). 
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TABLE ni (Coneiud§d) 

ClaMifleation of PropoMk ' Democratie Bepublican Total 
Party Party 

II. PnbUe Utilities 82 20 62 

1. Regulation / 16 11 27 

2. Speeiilc Propoaala of Bamediea 9 6 16 

(a) Bxtonaion of State Railroad Oornmia- 

Bion*a Jnriidiction to Pnblie Utilities 2-8 
Popular Vote on rranehise Grants . . .8-1 

Pnblieity 1-0 

Prohibition of Free Service to Pnblio 
Offleials by Gas and Electric Company 0*1 

(e) Extension of Power of Railroad and 
Water Supply Gommiasion 1-0 

(f) Arbitration of Disputes Inroliing 
Public Service Corporations 1-0 

(g) Provision Giving Public Utility Com- 
mission Power to Fix Rates 0-1 

(h) Stocks, Bonds, Rates 1-0 

8. Taxation , 7 8 10 

Ad Valorem System 0-1 

Physical Valuation 6-1 

Excessive Franchise Taxes 0-1 

[d) Assessment and Taxation on Same 

Basis as Other Property 1-0 

m. Railroads 87 27 64 

1. Railroad Commission (ers) 10 8 18 

(a) Replacement by Public Service Com- 
mission 1-0 

(b) Election of R. R. Commissioners In 

{tlace of State Board of Assessors 0-1 
ncrease of Power 2-2 

Extension of Jurisdiction 2-8 

Commendation of Smrvice 1-2 

(f ) Condemnation of Service 1-0 

Efforts to Weaken Condemned 1-0 

Honest and Efficient Discharge of Du- 
Ues 1-0 

(i) Popular Election of Commissioners 

Opposed 1-0 

2. Regulation 4 4 

8. Rates 11 4 16 

Freight 1-0 

Passenger Fare 1-1 

Freight and Passenger 7-8 

[d) Freight and Passenger Rate Dis- 
crimination 2-0 

4. Political Influence 6 6 12 

Intended Control of Legislative Action 1-0 

Domination of Partr Councils 0-1 

Interference with Elections 0-1 

(d) Domination of State by Southern P»- 

f iflc Railroad 1-0 

Political Bureau of Southern Paciiic..l-0 
Anti-pass Laws 2*8 

[g) Pennission of Passes to Specified Per- 
sons 1-1 

(h) Special Favors to Public Officials by 

Transportation Companies 0*1 

5. Physical Valuation 6 

6. Encouragement of Competing Lines 1 

7. Modernisation of State Railway Laws 

8. Increased Railroad Facilities 1 

9. Abolition of Grade Crossings 1 

10. Approval of Charter Grant 

11. Maximum of Fourteen Hours for Trainmen 1 

Grand Total: 
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TABLE nr 

KATIOVAb PABTT PLATTOBMS — BUUUAMY OF BAKX8 BT TSAB8 
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Industry 14 12 18 16 5 
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Labor 86 16 6966761184 

LcgiBUtion 4 4 10 9 9 14 16 18 15 16 14 11 28 17 

Monetary System 12 9 7 7 7 6 12 8 1 2 12 6 6 14 

Moral Reform 111118 98 11108 6 6 610 2210 

Katoralisation 12 12 20 v 
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IKTEBPBETATION OF DATA 

The material that has been presented in the preceding tables 
was subject to several methods of treatment in order to bring 
oat its significance. Table lY shows the first step in the treatment 
I^ ranks. It reads as follows: commerce was not mentioned in 
political platforms dnring the years 1814-56; it ranked fifth in 
1860, was not mentioned in 1861 or 1868, ranked fifteenth in 1872, 
etc. 

Table V is derived from Table IV and reads as follows : Com- 
merce ranked foorth in one year; fifth in one year; sixth in one 
year; ninth in three years; tenth in one year; eleventh in one year; 
fourteenth in two years ; and fifteenth in two years. 

The following scale of value was then used to bring out the rel- 
ative ranking of these several topics throughout the entire period. 
The topic ''Naturalization" occupied such an insignificant place 
that it was dropped from consideration. The remaining twenty- 
five topics practically cover the entire field of political discussion. 
Assuming that all occur in any one year and that the lowest ranking 
topic, the twenty-fifth, is to be given the lowest unit value, i. 6., one, 
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the twenty-fourth, two, etc., we get from Table V the following 
resolt: 



Finance, Pablie 
Office, Public 
Foreign BelationB 
Moral Bef orm 
Immigration 
CorporationB 
Natural Beeonrces 
Labor 



440 Monetary System 

349 Defence 

342 Works 

340 Legislation 

283 Commerce 

273 Territories 

267 Personal Bights 

261 Suffrage 



261 Gonstitntion 


154 


224 Parties 


149 


221 State Bights 


137 


212 Education 


122 


191 Postal System 


95 


187 Justice 


81 


170 Industry 


70 


159 Health 


32 



The Democratic Platforms were subjected to the same treat- 
ment, separately, with the following results : 

Finance, Public 

Foreign Belations 

Office 

State Bights 

Territories 

Labor 

Legislation 

Corporations 

The Republican Platforms were subjected to the same treat- 
ment, separately, with the following results: 
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19 



In order to serve as a check on this result the five Tiighest rank- 
ing topics in each campaign were evaluated by g:iving five points to 
first rank, four to second rank, etc. 

The results obtained were : 

Finance 
Moral Beform 
Foreign Belations 
Office 

Corporations 
Demce 

The results of these various treatments are brought together for 
easy reference in Table VI. 
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The second method of treatment designed to bring oat the in- 
terpretation of the daasified material, was the summation of linear 
inches devoted to each topic daring the entire period treated This 
is shown in Table Vll, which reads as fdlows: Commerce was not 
mentioned ontil 1860. In that year 31 linear inches was devoted 
to its discassion ; in 1872, 8 linear inches ; etc, with a total of 966 
linear inches daring the entire period from 1844 to 1916. This 
is 3 percent (trae to 1/10 of a percent) of the entire platform dis- 
cussions of problems, and it ranked 12th in importance. 

If the entire period covered by the national platforms is subdi- 
vided into the Pre-Reconstruction Period (1844-1868) and the Post- 
Beconstraction Period (1872-1916) and the latter is again divided 
into two periods (1872-1892 and 1896-1916) we obtain an interest- 
ing table for comparison, Table VIII. 



TABLE vn 

LINXAB INCHES GIVEK TO VAiqOUS FFEMS IH NATIONAL PABTT PLAT- 

P0RM8--lUlfMART BT YEARS 

ToptcT 1844 1848 1852 1856 1860 1864 1868 T872 1876 1880 1884 

Oommeree 81 8 17 164 

Gonstitution 10 17 67 17 78 7 182 08 

Corpontions 65 5 25 18 44 160 

DefenM 54 44 285 05 05 10 14 

EducAtion 5 84 25 10 

FiiiAnee 82 108 148 00 25 28 180 161 844 08 881 

Foreign Relation! .... 100 145 82 42 68 58 58 167 

Healtb 

ImmiffnUon 28 28 45 61 8 26 14 28 41 51 72 

Induitry 11 62 

Jnttieo 20 

Labor 10 78 8 40 00 

Logiilation 80 88 88 88 44 17 20 

Monetory Syitom .... 5 47 66 40 127 

Moral Reform 586 264 275 411 210 51 88 186 265 470 

Naturalisation 11 4 

Natural Retonreei ... 22 80 27 20 20 48 86 10 108 

Offlee 8 7 18 48 88 72 162 211 120 111 

Partiei 161 87 188 143 

Peniions 48 12 81 15 56 

Personal RighU 26 26 65 82 8 22 88 18 

Postal System 8 4 7 

Stote RighU 41 62 88 74 24 

Suffrage .4 7 85 06 

Territories 28 10 16 

Works 26 47 71 17 5 15 

Topics; 1888 1802 1806 1000 1004 1008 1012 1016TotalPerc«ntRank 

Oommeree 28 60 08 121 76 60 151 208 066 8.0 12 

Gonstitution 182 08 22 48 14 528 1.6 18 

Oorporations 148 112 187 870 180 572 465 175 2520 7.5 4 

De^noo 18 14 18 148 41 80 66 685 1556 4.8 8 

Education 20 77 10 7 2 10 87 882 1.0 28 

Finance 476 220 488 187 224 808 481 854 4176 12.0 1 

Foreign Relations ... 152 166 168 264 167 187 110 815 2680 8.3 8 

Healtb 50 02 82 174 .5 24 

Immigration 08 70 24 40 48 52 22 808 2.5 14 

Industry 75 61 258 567 1.4 20 

JusUce 15 20 2 57 208 28 840 1.1 22 
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TABLE VII iOon<Aud0d) 



Labor 122 

LegislAiioii 

IConetAiy SyBtem .... 66 

Moiml Reform 00 

NftturaliiAtiGii 6 

Nfttnral Rmourees . . . 210 

OAee 124 

Parties 

Peniions 68 

Penonal Rights 

Postal Sjstem 4 

Bute RighU 

Suffrage 102 

Territories 08 

Worlis 8 



125 
18 

100 

70 

8 

101 

104 
87 
61 

82 

60 
58 
50 



111 

86 

781 

188 

122 
00 

78 
41 

70 
40 
75 
25 



168 

45 

470 

261 

86 
78 

80 

6 

48 

504 
106 



201 
20 
86 

128 



101 

40 

10 

86 

6 

24 

186 

02 



685 

104 

216 

48 

150 

287 

126 

88 

80 

58 

62 

185 

124 



808 200 2888 7.8 5 

24 10 475 1.5 10 

228 51 2800 7.1 6 

82 07 8588 10.0 2 

24 .1 26 

872 77 1470 4.5 

180 1708 5.5 7 

286 00 1012 8.1 11 

22 10 582 1.8 15 

66 10 802 1.2 21 

48 27 171 .5 25 

120 527 1.6 17 

18 65 574 2.8 16 

112 145 1866 4.8 10 

207 05 807 2.8 18 



TABLE Vm 

SPACE GIVEN TO VARIOUS ITEMS IN NATIONAL PLATFORMS— SUlfMARIZED 

BT PERIODS 

Topics 



Linear Inches 


Pereents 


Period 


I 


II 


III 


IV 


V 


I 


II 


III 


IV 


V 


Commerce 


066 


81 


005 


286 


700 


8.0 


.6 


8.7 


8.1 


4.0 


Constitution 


528 


214 


800 


460 


70 


1.6 


4.4 


1.1 


4.0 


.4 


Corporations 

Defence 


2520 


70 


2450 


501 


1058 


7.5 


1.4 


0.1 


5.4 


10.0 


1556 


428 


1128 


146 


082 


4.8 


8.6 


4.2 


1.6 


5.5 


Education 


882 





882 


280 


03 


1.0 


0.0 


1.2 


2.6 


.5 


Finance 


4176 


610 


8566 


1684 


1882 


12.0 


12.4 


18.2 


18.1 


10.5 


Foreign Relations . . 
Health 


aDoO 


387 


2802 


501 


1711 


8.8 


7.0 


8.5 


6.8 


0.5 


174 





174 





348 


.5 


0.0 


.6 


.0 


1.0 


Immigration 


808 


100 


604 


850 


1007 


2.5 


4.0 


2.2 


8.8 


5.6 


Industry 


467 





467 


78 


861 


1.4 


0.0 


1.7 


.8 


4.8 


Justice 


840 





840 


85 


668 


1.1 


0.0 


1.8 


.4 


8.7 


Labor 


2888 


10 


2878 


486 


1807 


7.8 


.2 


8.8 


5.2 


10.6 


Legislation 


475 


120 


846 


00 


247 


1.5 


2.6 


1.8 


1.1 


1.4 


Monetary Sjstem . . 


2800 


14 


2286 


545 


1721 


7.1 


.8 


8.8 


5.0 


0.6 


Moral Reform .... 


8588 


1756 


1777 


1078 


600 


10.0 


85.6 


6.6 


11.6 


8.0 


Naturalisation .... 


24 


15 











.1 


.8 




.1 


.0 


Natural Resources . . 


1470 


128 


1842 


426 


816 


4.5 


2.6 


5.0 


4.6 


4.6 


Oflice 


1708 


186 


1612 


022 


600 


5.5 


8.8 


5.0 


0.0 


8.1 


Parties 


1012 


161 


851 


850 


501 


3.1 


8.8 


8.1 


8.8 


2.8 


Pensions 


582 


48 


580 


281 


256 


1.8 


.0 


2.0 


2.5 


1.4 


Personal Rights . . . 


802 


157 


285 


78 


162 


1.2 


3.2 


.0 


.8 


.0 


Postal Sjstem 


171 


7 


164 


48 


121 


.5 


.1 


.6 


.5 


.7 


State RighU 


527 


260 


267 


24 


243 


1.6 


5.8 


1.0 


.8 


1.8 


Suffrage 


574 





567 


818 


252 


2.8 


.2 


2.0 


8.4 


1.4 


Territories 


1866 


42 


1824 


167 


1157 


4.8 


.0 


4.0 


1.8 


6.5 


Works 


807 


170 


727 


78 


640 


2.8 


8.5 


2.7 


.8 


8.6 



Column I: 1844 to 1016 

Column II: 1844 to 1868 (Pre-Reconstruction Period) 

Column III: 1868 to 1016 (Post-Reconstruction Period) 

Column IV: 1872 to 1802 

Column V: 1802 to 1016 



In Table IX is given the summary of all state platforms on 
national issues in non-presidential years from 1889 to 1914. The 
rankings in this table are determined by the number of distinct 
platform proposals. The scale of values used is the same as for 
Table VI (five highest rankings). Table X shows the summary for 
the state platforms of 1910 on state issues; the unit used is the 
single platform proposal. 
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TABLE IX 

PROPOSALS IN STATE PLATFORMS ABOUT NATIONAL ISSUES DURDfa NON- 
PRESIDENTIAL YEARS 1880 i» 1014 



Problem! 


Ranks 


Values 


Tot«l 




I 


n 


m 


IV 


V 


z5 


z4 


z8 


z2 


zl 




Finance 


7 


6 


4 


1 





85 


24 


12 


2 





78 


Offlce 


8 


8 


5 


8 





15 


12 


15 


6 





48 


Ck>rporationa 


2 


8 


1 


8 


4 


10 


12 


8 


6 


4 


85 


Monetary Syitem 


8 


2 


8 





2 


15 


8 








2 


84 


Labor 


1 
1 


1 



1 
2 


8 

1 


2 
8 


5 
5 


4 



8 
6 


6 
2 


2 
8 


20 


Commerce 


16 


Suffrase 



1 



1 
1 
1 


2 

1 


2 
2 

1 





4 



5 



4 
4 
4 


6 

8 


4 
4 
2 





4 


14 


Defence 


18 


Moral Refonn 


18 


Pensions 





1 





2 


8 





4 





4 


8 


11 


Foreign Relations 

Legislation 








2 


1 


1 








6 


2 


1 


9 











2 


2 











4 


2 


6 


State Rights 

Natural Resonrees 








1 





1 








8 





1 


4 








1 


1 











8 


2 





6 


Persona] Rights 











2 














4 





4 


Immigration 











1 


2 











2 


2 


4 


Territories 





1 








1 





4 








1 


5 


Parties 











1 














2 





2 


Works 











1 














2 





2 


Health 














1 





1 














2 





1 


2 


Justice 


1 



TABLE X 
PROPOSALS IN STATE PLATFORMS ABOUT STATE ISSUES, IN 1010 



Topics 


Number of Proposals 


Total 


Rank 


Democratic | Republican 


Office 


248 
01 
80 
70 
50 
49 
48 
88 
86 

27 
10 
21 
5 

6 
8 
8 
8 


180 

66 

78 

66 

51 

50 

87 

84 

24 

25 

10 

22 

15 

18 

6 

4 

4 

8 

18 


878 

156 

158 

145 

110 

00 

80 

72 

60 

56 

46 

41 

86 

18 

15 

10 

7 

6 

21 




Corporations 




Labor 




Finance 




Natural Resources 

Moral Reform 




Works. Public 




Education 




Legislation 

Industry 




Constitution 

Justice 




Parties 




Health 




Municipal Corporations 

Monetary System 


^ gt 


Pensions 




Immigration 




Miscellaneous 


m • 



CONCLUSIONS 

It has been impossible in the space allotted to this review 
to present its methods and results in fullest detail, but even in the 
present incomplete form of the study a careful scrutiny of the sum- 
maries permits us to draw a few conclusions 

1. Certain problems, in their broad outlines, are necessarily 
persistent, since they are inherent in the structure or constituent 



CONTENT OF C0UB8E OF STUDY IN CIVICS 79 

functions of government, e. g., public finance, publio office, foreign 
relations and national defence. 

2. Certain other problems are persistent from the economic 
organization of society, e. g., corporations (representing the cap- 
italist), labor (representing the producer), and natural resources 
(representing the third factor of production) . 

3. A third group of problems, which the writer has classified 
under ''moral reform," is necessarily persistent so long as there 
are men and women who are forward-looking, and subject to hu- 
manitarian impulses ; and so long as a democratic form of govern- 
ment renders all social problems iwtentially political. The term 
'moral reform' has been used in lieu of the more commonly em- 
ployed term 'social reform,' for the reason that a moral judgment 
rather than an economic or administrative judgment is the deter- 
mining factor in the voter's decision. 

4. Certain Other problems are relatively persistent as corol- 
lary to our governmental or economic organization and status, e, g., 
immigration (a result of better economic opportunities in this 
country than obtain in other parts of the world), foreign commerce 
(a result of our power of economic production), state rights (a 
result of the historic origin of the Federal government), consti- 
tutions (fundamental limitation of governmental action), and po- 
litical parties (arising from the problem of registering the popular 
will). 

5. The responsibility for the solution of these various prob- 
lems has been distributed among the three most important units 
of government in this country, viz., national, state, and municipal, 
or local, government. For example, foreign relations belongs ex- 
clusively to the Federal government ; conduct of elections and suf- 
frage qualifications largely to the states; education is delegated 
largely to the local units. 

6. There are certain tendencies evident from a careful study 
of the data: the problems of strict or liberal construction of the 
Constitution, state rights, personal rights, etc., tend to become of 
less importance in political discussion; while labor, corporations, 
and foreign relations tend to become of more importance ; still other 
problems like public finance, commerce, and defence about hold 
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their own ; health, industry, and justice appear to be gaining in 
importance; all topics of discussion are fundamentally affected 
by the two general trends which the writer believes he discovers 
beneath the surface of our national life — ^the trend toward 
more efficient nationalism and toward more complete democracy, 
through the socialization of industry and the democratization of 
parties. 

7. From all that has gone before, it is safe to assume that 
any course of instruction whose purpose is to prepare for intelli- 
gent suffrage through the exercise of civic judgments upon con- 
crete problems should contain at least the following topics : finance 
— ^federal, state, municipal, and school district; office, elections, 
civil service, etc., including the related topics of parties and 
suffrage as applied to the locality; corporations; labor; foreign re- 
lations, including relations to defence and commerce; natural re- 
sources, conservation and reclamation; monetary system — ^money, 
banking, and credit ; and the present moral issues of nation, state, 
and community. 

8. Recognizing with Professor Eeatinge of Oxford {Studies 
in Education) , that grave difficulties lie in the way of any adequate 
treatment of politics in the public school, but likewise recognizing 
with him the necessity of such preparation in an increasingly dem- 
ocratic state, the writer believes such instruction is feasible and nec- 
essary. The following quotation expresses his view of the need: 
''To any one who considers that the final decision as to policy and 
legislation of every kind, imperial, financial, and social, is made, 
theoretically at any rate, by the mass of individual voters, to any 
one who considers further that the number of male voters is in the 
near future sure to be largely increased and that probably there 
will be added to them a large number of female voters, there can 
be little doubt that an important duty of our schools is to give a 
training which shall enable our children, as they grow up, to take 
an intelligent interest in political life, and to register their votes 
when the time comes for them to do so in connection with some in- 
telligible body of principles." 
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CHAPTER Vin 

THE HISTORICAL INFORMATION ESSENTIAL FOR THE 
INTELLIGENT UNDERSTANDING OF CIVIC PROBLEMS 



B. B. Bassxtt 
State University of Iowa 



OBJSGT 



The present study is an outgrowth of the study reported by 
Horn in the Sixteenth Yearbook of this Society, Chapter X. Horn 
sought to discover what history is most needed for the intelligent 
understanding of modem problems, conditions and activities. The 
present investigation is more limited in scope. It seeks to discover 
what history is most necessary to the intelligent understanding of 
modem political problems, conditions and activities. As in the case 
of the former study, no brief is hdd for this or any purpose as the 
one which should determine the content of the history curriculum. 

METHOD 

The investigation was undertaken with the same hypothesis 
as that used by Dr. Horn, viz.: 'Hhat if a representative list of 
the more crucial modem problems could be secured, and if among 
the books dealing with each problem, those be selected which give 
the clearest statement of that problem, it might be expected that 
these books would contain at least the sort of history, or amount of 
historical reference which in the judgment of the authors is essen- 
tial to a proper understanding of the modem problems they are 
discussing." 

Accordingly, members of the staff in the Department of Polit- 
ical Science of the State University of Iowa were asked to make a 
list of crucial present-day political problems and to indicate a 
book dealing in a representative manner with each of these prob- 
lems. Books which dealt primarily with local conditions, and also 
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books which were plainly historical were barred from consideration. 
The following list of twenty-two books was chosen as a basis 
of the study : 

1. Adams — Seienee of Finance. (Taxation) 

2. Bolen^-PUUn Facts aa to iM Tf%9t and the Tariff, Pt. n. 

3. Brown — Tramj^ortaition Bates and theiir BegvXation. 

4. ChUds— T^ Short Balm Principle. 

5. Committee of Fittj—The Liquor Problem 

6. Commons — Proportional Bepresentadion 

7. Fairchild — Immigration 

8. Goodnow — Administrative Law 

9. 'RM— Outline of Intemationai Law 

10. ILsjne»— Child Labor 

11. Uxmiei^-Poverty (Poor Belief) 

12. Jenkfr— r^ Trust Problem 

13. Jones — Statute Law-Making 

14. Mathews — Woman Suffrage 

15. Mullenr— r^ A. B, C, of NationaX Defense 

16. Monro— IfunAcipoI Government 

17. Bav— PoIiticaZ Parties and Practical Politics 

18. Beinsch — Beadings on American Qovermment (Civil Service) 

19. Byan — A Living Wage (Minimum Wage) 

20. Seager — Social Insurance 

21. Taft — Popular Qotvemment (Initiative, Beferendnm) 

22.' Beport Belatine to Legislative Beference Bureaus bv librarian of 
Congress in Senate Documents, 62nd Congress, 1st Session, No. 7 

To supplement the data secured from these books, twenty-two 
articles, corresponding in subject matter with the material found in 
each of the several books, were checked in the Cyclopedia of Amer- 
ican Oovemment. The data thus obtained were compiled separately 
and are frequently compared with those from the books. 

In analyzing the material, both in the books and in the cyclo- 
pedia articles, an attempt was made to secure the following classes 
of data: (1) the historical characters referred to in each book; 
(2) specific dates, and the frequency of reference to the various per- 
iods in history ;i (3) the frequency of reference to the leading for- 
eign countries; and (4) historical movements, events, conditions 
and problems. 

In analyzing the material of this last class an outline given by 
Albion W. Small in his Oeneral Sociology was used as a basis. Ac- 
cording to Mr. Small's presentation, there are six general heads 
uuder which the efforts and activities of man may be grouped, viz : 

^For periods prior to 1860, the classification was made to correspond to 
that followed bj Dr. Horn in bis study in the Siaieenth Yearbook. Following 
the date 1860, ten-year periods were nsed. 
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I. Achievements for the Protection of Health. 

II. Achievements for the Promotion of Wealth. 

ni. Achievements in Harmonizing Human Relations. 

A. Political Achievements. 

B. Industrial and Property Interests. 

C. Opportunities for Culture. 

IV. Achievements in Discovery and Spread of Knowledge. 

V. Achievements in Fine Arts. 

VI. Achievements in Religion. 

Under each of these main headings Mr. Small indicates a large 
number of topics and sub-topics. While it was not found advisable 
to use these sub-topics in tabulating the data from the books and 
the encyclopedia, they were of use in interpreting the headings. 

In checking and classifying these historical data, the follow- 
ing rules and regulations were observed : 

(1) Score only those references that are clearly historical. 

(2) In case of historical movements, events and problems., 
indicate them in the specific terms of the author, and place the ref- 
erence under the main section of the outline where it seems most 
logically to belong. In case the reference clearly has a double sig- 
nificance it may be checked under two headings, as, for example, 
under ''Protection of Health" and under ** Achievements in Har- 
monizing Human Relations. "^ 

(3) Score any given item but once in a single paragraph. 

(4) Dates in parentheses are not to be checked. 

The analysis of a single paragraph may serve further to il- 
lustrate the classes of data desired, and the method used in check- 
ing the material. The following paragraphs taken from a contem- 
porary writer upon ** Equal Suffrage" will serve as the basis of this 
analysis. 

**The movement for equal suffrage may be said to have begun 
in England toward the close of the eighteenth century. In 1792 
Mary WoUstonecraft published a book on the Vindication of the 
Rights of Women which, though greeted with a storm of ridicule 
and abuse, gave the first considerable impulse to a discussion on the 
subject. In 1797 Charles Fox is quoted as saying that all the su- 
perior classes of the female sex in England must be more capable of 

'A legislative measure dealing with health regulations, or one providing 
for the use of safety devices might fall thus under two headings. 
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exercising the elective Boffrage with deliberation and propriety than 
the uninformed individuals of the lowest class of men to whom the 
advocates of universal suffrage would extend it. Bentham likewise 
remarked upon the injustice of refusing women the right to vote. 
In 1835 Bailey strongly advocated the extension of the suffrage to 
women in his treatise entitled The Rationale of Political Represen- 
tation. Likewise, Benjamin Disraeli in 1848 declared in the House 
of Commons that he saw no reason for denying women the right 
to vote. But the most influential advocate of equal suffrage in 
England was John Stuart Mill, who espoused the cause with great 
power in his book on The Subjugation of Women, published in 1869. 
Moreover, in 1867 Mill championed the cause of equal suffrage in 
the House of Commons by proposing it as an amendment to the 
Reform Bill then pending. ' ' 

The specific items of historic interest in this paragraph are 
(1) Equal Suffrage, a subject to be classified under ''Achievements 
in Harmonizing Human Relations;" (2) the Reform Bill, likewise 
under ** Achievements in Harmonizing Human Relations," and (3) 
England, to be placed under * * Leading Foreign Countries. ' * Equal 
suffrage is mentioned three times, but since it is within a single 
paragraph, the subject is checked only once. England is mentioned 
twice, but is checked once. 

The specific dates occurring in this paragraph are 1792, 1797, 
1835, 1848, 1867, 1869. The general period of the eighteenth cen- 
tury is also mentioned. 

The historical characters mentioned are Bailey, Bentham, Ben- 
jamin Disraeli, Charles Fox, John Stuart Mill, and Mary Woll- 
stonecroft. Each of these persons is checked once, notwithstanding 
the fact that Mill 's name appears twice. 

RESni^B 

Persons. In analyzing the twenty-two books, a total of 563 
names was found. Of this list many appeared but once ; others ap- 
peared several times but in connection with a single subject. Twen- 
ty-three of the names appeared in connection with at least three 
subjects. These names are as follows : 
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TABLB I 

REFERENCES TO PERSONS IN TWENT7TW0 BOOKS 

Different Number of timet 
Problems mentioned Prodnd 

1. Rooeerelt. Pres 10 

2. CleveUnd, Pres 7 

8. Smith, Adsm 5 

4. McKinley, Pres 6 

6. Tsft, Pres 4 

6. Jsenon, Pres. 4 

7. Grant. Pres 6 

8. Mill, John Stuart 6 

0. Wilson. Pres 6 

10. Osrfleld, Pres 4 

11. Mslthns 4 

12. MontesQuieu 8 

18. Eliot Charles W. 4 

14. Hamilton, Alexander 4 

15. Harrison, Pres. W. H 8 

16. Walker, Francis 8 

17. Hughes, Charles Evans 8 

18. Lincoln 8 

10. Bryce, James 8 

20. Clay, Henry 8 

21. Cobden, Richard 8 

22. List, Frederick 8 

28. Washington, Pres 8 

In analyzing the twenty-two articles in the Cyclopedia of Amer- 
ican Government, seventy-nine names were found. Only five of 
these names, however, were found in connection with more than 
one subject. The names ranking highest in these articles are shown 
in Table II. 

TABLE n 
REFERENCES TO PERSONS IN TWENTY-TWO CYCLOPEDIA ARTICLES 



26 


260 





68 


11 


66 





45 


11 


44 


11 


44 


8 


40 


8 


40 


6 


86 


8 


82 


8 


82 


7 


21 


4 


16 


4 


16 


6 


16 


6 


16 


4 


12 


4 


12 


8 





8 





8 


9 


8 


9 


8 


9 





Number of 
Articles 


Number of times 
mentioned 


Product 


Clereland 


4 


6 
6 

4 
6 
2 


24 


Taft 

Roosevelt 

Wilson 

Wright. Francis 


4 

8 

2 

2 


24 
12 
10 

4 



Thus this, like previous studies, seems to indicate that in dis- 
cussing modem civic problems authors refer more frequently to the 
names of presidents than to any other group. Six of the names — 
Cleveland, McKinley, Jackson, Qrant, Lincoln, and Clay — are found 
among the list obtained in a similar study by the graduate students 
of the University of Illinois. Moreover, five of the names, Roose- 
velt, Adam Smith, John Stuart Mill, Malthus, and Wilson, occur in 
the list obtained by Horn. On the other hand, it will be observed 
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that the list varies widely from that presented in Bagley's ''Hall of 
Fame," in which the names were derived from current textbooks 
in elementary American history. 

Dates. In the books analyzed, 214 dates were found, and in 
the Cylopedia of American Oovemment 89, a total of 221, many of 
which appeared but once. The following twenty dates, eighteen 
of which are in the period since 1890, appear most frequently : 

TABLE m 
REFERENCES TO DATES IN BOOKS AND CYCLOPEDIA ARTICLES COMBINED 

Dmte Different Times 

Problems Mentioiied 

1882 9 84 

1887 14 84 

1890 20 66 

1808 14 



1894 14 64 

1896 18 48 

1897 17 68 

1898 16 41 

1899 11 86 

1900 18 78 

1901 21 41 
1908 16 86 

1004 11 87 

1906 10 88 

1907 18 61 

1908 18 71 

1909 12 46 

1910 17 78 

1911 14 86 
1012 19 69 

Recent dates obviously appear much more often in discussion 
of these modem political problems than do dates more remote. 
Moreover, the dates commonly required in the study of history, and 
those recommended by the members of the American Historical 
Association, are not frequently referred to. The date 1492 was 
found but once, and that in connection with the problem of immi- 
^ation. In like manner, the date 1607 appeared but once, and 
1812 but six times, while 1765, and April 14th, 1861, were not found 
in any of the books or articles. Morel than 90 percent of the dates 
mentioned were subsequent to 1812, while (see Table IV) in current 
textbooks in elementary history less than 46 percent of the space is 
devoted to this period. The contrast is even ^eater if limited to the 
period since 1860. 
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Hiitcricdl Periods. A study of the frequency of reference in 
these books and articles to historical periods indicates that in dis- 
enasing modem problems, authors refer frequently to recent peri- 
ods, whereas in the elementary texts much attention is given to more 
remote periods. The data for American History from the present 
study are summarized in the table below, along with the data from 
the studies by Horn, and by Bagley and Bugg. In the latter study 
the data are those for textbooks published between 1904 and 1812. 

TABLE rv 

HISTORICAL BEFEBBNOES OLASSIFIED BT PEBI0D8 

Horn Baglej k Bngg Pretentwwl 
Period International Elementary 
Booka Cyclopedia Te»ta 

Undaaaiiied 

Diac and Exploration 0.1 

061. to 1764 2.6 

17M-1788 8.8 

17881812 1.8 

1812-1861 4.7 

18611916 5.7 

The analysis of the period from 1861 to 1916 as found in the 
present investigation, follows in Table V : 

TABLE y 
BEFEREKOES TO MODERN PERIOD FUBTHEB ANALYZED 

Period Percentage of referencea to 
Each Period 

1860-1870 8.68 

1870-1880 7.04 

1880-1800 10.58 

1800-1000 20.68 

1900-1010 22.17 

1010-1017 10.27 



8.7 






0.67 


8.27 


0.98 


2.0 


19.62 


2.46 


8.5 


18.69 


1.72 


6.0 


14.17 


4.88 


11.0 


21.00 


16.89 


74.0 


24.67 


74.12 



Total ainoe 1860 74.12 



The frequency of reference to foreign countries, as found in 
this study, corresponds closely to the results obtained in the study 
by Horn. He reports that the countries most frequently mentioned 
are England, Germany, France and Russia. The present study 
shows that in a discussion of modem civic problems authors refer 
to England more than twice as often as to any other foreign country ; 
(Jermany ranks second and France third. 

The portion of the study which has to do with the various 
phases of history as a background for civic problems is still incom- 
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plete, but the data so far gathered seem to suggest certain con- 
clusions. In discussing modem civic problems the authors we have 
examined make very few references which could be classified under 
''Achievements in Discovery and Spread of Knowledge," *'in Fine 
Arts'' or ''in Religion.'' Especially is this true of "Pine Arts," 
which are scarcely mentioned in any of the books or articles an- 
alyzed. Under "Achievements for the Protection of Health," 
a few topics clearly receive the most frequent mention. 
Among these are sanitation, care of the sick, pure food, 
improved safety devices, health regulations in factories, and 
recreation. In connection with "Achievements for the Pro- 
motion of Wealth," the chief topics of discussion are trade 
and commerce, manufacturing, agriculture, transportation, wages, 
and labor. By far the greater number of historical movements and 
events are classified under "Achievements in Harmonizing Human 
Relations." The subject that receives the most frequent mention 
is legislation — ^federal, state, and foreign. The specific topics most 
frequently mentioned are : Tariff, Municipal Government, Political 
Parties; Boards, Bureaus and Commissions; Civil Service, Elec- 
tions, the Federal Constitution, Referendum, Initiative, Short Bal- 
lot, Taxation, Transportation, and Poor Relief. Referring back to 
the list previously given of the titles of books included in this study, 
it will be seen that each one of these topics (with the sole exceptions 
of the Federal Constitution, and Elections) is specifically the sub- 
ject of one of the books included. Nine of the twenty-two books are 
thus represented: this may mean that these nine books are more 
important than the rest, or merely that they are longer. Thus, 
this last list, though apparently significant, conceivably has very 
little meaning. 

An investigation of this sort cannot, of course, prescribe the 
details of a course of study. But in general, the indications seem 
to be that, aside from the names of presidents, those of economists 
are the names with which a student of modem political problems 
needs to be familiar; that a knowledge of recent dates (especially 
since 1890) and of the recent period in American history (again 
especially since 1890, for 53 percent of all references to periods be- 
long to this one), together with a knowledge of the Federal Consti- 
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tation, 18 that American liistorieal knowledge which is for him 
the most illuminating; and that of foreign lands, England ont- 
weighs all the rest in contributions towards the problems he has 
to scdTC.' In conclusion it mav be well to repeat that this study has 
not aimed to consider the historical background of any other than 
political phase of modem life. 



Tlds appmrent importaiiee of Engiand may howerer be due to our com- 
DMm language. Works in other languages are on the whole mneh leee aeeeesi- 
Ue to aoch anthon as wrote the bools in question. 



CHAPTER IX 

A METHOD OF DETERMINING MISPLACEMENTS OF EM- 
PHASIS IN SEVENTH AND EIGHTH-GRADE HISTORY 



L. B. MAB8TON, H. 0. MeKOWN AND W. G. BAGLEY 
(A atiidy made at the School of Education, Univeraitj of Illinois.) 



INTBODncnON 

The report on Tninimal essentials in American history which 
appeared in the Sixteenth Yearbook attempted to state present-day 
minimal essentials as determined by an analysis of textbooks used 
in the seventh and eighth grades and by the recommendations of 
the Committee of Eight of the American Historical Association. 
The data regarding the textbooks were summarized from a detailed 
study of twenty-five texts,* the results of which were published as 
Bulletin No. i6 of the School of Education^ University of Illinois. 
Both the original study and the summarized report emphasized the 
fact that this method could determine only what the minimal essen- 
tials are as the subject has been taught in the past and as it is taught 
today. It cannot determine what these essentials should be, al- 
though it may trace the changes that have been taking place and 
consequently reveal tendencies. The study in question, for example, 
disclosed significant tendencies (as, for example, the lessening em- 
phasis upon military affairs during the past three decades) which 
are doubtless symptomatic of changing ideals as to the aims that the 
elementary teaching of history should seek to realize. 

The i^tudy reported herewith attempts to determine more pre- 
cisely some of the misplacements of emphasis in the present-day 
and relatively recent teaching of elementary history. In order to 
make this determination, certain criteria must be selected against 
which to measure present practices. As x>erniitting application to 

^Eight of theee textbooks were published prior to 1890; nine were pub* 
lished between 1902 and 1912. 
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the textbooks used in the seventh and eighth grades, the following 
criteria were chosen: — 

(1) Are the relative emphases given to events in the text- 
books consistent with the emphases given to the same events in 
standard books of reference f 

(2) Are the relative emphases given by the textbooks con- 
sistent with the judgment of students of history regarding the 
events that should be emphasized f 

(3) Are the relative emphases given by the textbooks con- 
sistent with the need for historical knowledge in interpreting cur- 
rent discussions of national problems as these are revealed in peri- 
odical literature! 

To subject the content of the courses in history taught in the 
elementary schools to these and other desirable criteria is something 
that should be done. Indeed, when one reflects upon the funda- 
mental bearing of universal elementary education on our national 
life, it is inconceivable that the actual content of instruction in any 
subject of study should be permitted to escape the closest possible 
scrutiny and evaluation by means of impartial and objective meth- 
ods, which are themselves susceptible of scientific control and eval- 
uation. To make such an examination of all the materials now 
comprising the content of elementary history, however, would in- 
volve an expenditure of time and money out of the question in 
connection with the present study. All that could be done here, 
as in the investigations of history-materials reported in the Four- 
teenth Yearbook and in the Sixteenth Yearbook, was to explore a 
very limited area of the field for the purpose primarily of testing 
a method of procedure. 

The study was consequently limited to one type of textbook 
materials — ^the names of persons that are given prominence by 
twenty-five elementary textbooks in their treatment of the period 
of American history between the years of 1765 and 1865. These 
are listed in the BvUetin above referred to under the caption **The 
Hall of Fame. " Two lists are given, one comprising the twenty^ve 
names most frequently mentioned in the textbooks as prominent 
in the events of civil life, the other comprising the twenty-five 
names most frequently mentioned as prominent in military and 
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naval affairs. In each case the names are listed in the order of 
frequency and this order consequently forms an index of the rela- 
tive emphasis accorded by the textbooks to the persons named, and 
more indirectly to the events with which the names are associated. 
As was pointed out in the original study, the personal or concretely 
human elements are especially important and formative in the study 
of history by children and young adolescents; the lasting associa- 
tions cluster about names rather than about the more abstract, 
more impersonal events and movements ; consequentiy it is fair to 
assume that misplacements of emphasis here will be symptomatic 
of other and conceivably more fundamental distortions. 

METHOD 

The two lists of names presented in the Bulletin as constitut- 
ing the textbooks' ''Hall of Fame" may be considered as 'ratings' 
of the importance of persons named as figures in American history. 
To test the validity of these ratings, three other types of ratings 
of the same men were secured, each type representing one of the 
criteria referred to above : — 

(1) The ''Encyclopedia Ratings.** The following encyclo- 
pedias and dictionaries of biography formed the basis of this part 
of the study. 

Far both eMl and mOitary liaU: — 

The UfU/versid Cyclopedia and Ailaa 

The Eneyelopedia Briianniea 

Appleton's Cyclopedia of Ameriocm Biography 

The New International Cyclopedia 

Drake's Dictionary of American Biography 

Harper's Encyclopedia of American History 

For the oivU Uet only:— 

Lamb 's Biographical Dictionary of the United Statee 
National Encyclopedia of United States History 

The method here was to determine the amount of space devoted 
to each person in the text that appeared under his name, and to 
arrange the names in the order of the total amount of space each 
received. Four men found a place in both lists ; consequentiy, each 
of these four names was credited in the civil list only with the 
amount of space devoted to him as a participant in civil affairs, 
and credit in the military list was similarly limited. 
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( 2 ) The ' ' Historians * Ratings. * * The two lists of names were 
sent to 205 teachers and students of history in American schools 
and universities. The names in each list were arranged in alpha- 
betical order and a ranking of these names in the order of their 
** relative importance in American history" was requested. Sev- 
enty replies were received, of which, however, only thirty-three 
could be used. 

(3) The "Magazines* Eatings.** In order to determine 
whether the relative emphasis given to the persons named in the 
textbooks bore a definite relation to the need for information con- 
cerning these persons in interpreting current discussions,* 'samp- 
lings' from the files of four magazines covering a period of ten 
years (1904-1913, inclusive) were read, and two lists representing 
the frequencies of mention were constructed. The samplings were 
distributed over the ten years in such a way that each year was rep- 
resented by approximately the same number of issues. References 
to the four names appearing in both civil and military lists were 
treated separately, as in the case of the encyclopedia ratings. Each 
name was credited with one reference only for each article in which 
it appeared. The magazines and the number of issues of each that 

were read were as follows : — 

AtUuvtio Monthly ;20 isBues 

The Nation 78 ismieB 

CoUiera 88 ismieB 

Saturday Evening Pott 20 iBsaes 

In the tables that follow, the frequencies of reference in all of 
the magazines are combined.^ 

RESULTS AND INTERPRETATIONS 

The accompanying tables show the comparisons and correla- 
tions of the several rankings, together with the significant dis- 
placements of the textbooks' rankings as compared with the other 
rankings. In determining these displacements, all of the rankings 
(including those of the textbooks) were combined by adding the 
rankings for each name and arranging the names in order from the 

In the magazmee that were examined, seven of the flftj names that 
appear in the textbooks' lists were not mentioned: Samuel Adams in the eivil 
list, and Thomas, Howe, Sehuyler, Harrison, Early, and Gage in the military 
list. These were given ue lowest plaee in the two magarine rantingat 
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lowest to the highest total. The lists as presented herewith are 
given in the order of these 'amalgamated rankings.' 

It is especially noteworthy that the several rankings of men 
prominent in political life are in general much more highly correl- 
ated with one another than are the rankings of men prominent in 
military life. The textbooks' rankings show particularly low cor- 
relations with the other rankings in the military list, and this adds 
confirmation to the general opinion that the textbooks have tended 
to distort military history. More specifically, the traditional treat- 
ment of our wars by the textbooks has apparently underemphasized 
the achievements of the navy, and given too large a prominence to 
the British generals in the War of the Revolution. 

The textbooks' apparent misplacements of emphasis in the 
treatment of political affairs, in so far as a study of this type is com- 
petent to reveal such misplacements, are less numerous and less 
wide. It is significant, however, that in all probability, the text- 
books have not done full justice to Franklin, Webster, and Jefferson 
Davis. 

The names that should in justice be added to these two lists are 
fewer than one would expect, if the suggestions from historians 
and magazines are an index. The textbooks thai are used in the 
seventh and eighth grades have always emphasized the political and 
military history of the nation, and with changing conceptions of 
the functions of this elementary study of history, it is altogether 
probable that other names will come to replace those that have been, 
and are being given the positions of prominence. The following 
names not included among the twenty-five most frequently men- 
tioned by the textbooks were suggested by two or more historians 
or indicated by ratings from The Nation : 

TABLE I 

P088IBLB ADDITIONS TO NAHB8 BMPHASIZID IN BLBMBNTABT TBXTB00K8 
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TABLE IT 

DIBPLAOEICGNT OV TEXTBOOKS' OITIL TU3SKIVGB OF FOUR PLAOSS OB 

KOBE FBOU AXALOAIUTXD KANEIlIOa 

A. Texlbooki ■ppirimllT oturtmpliaiii* the ImporUnW of dipIaoBcant 

FUrick H«U7 plaew 

Mmdboo B 

John Adimi 4 " 

B. Taitbooki apparsntlr uiid«r<iiifiJkaft(« the fi 

Praitklln 

J»g«nH>n D«t1i 
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TABLE V 

RAHKDres or uh psominsht nr militabt akd naval affaibs bbtwkeb 

17«5 AND 1865 
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TABLE yn 

DISPLACEMENTS OF TEXTBOOKS^ MILITABT BANKINGS OF FOUB PLAGES OB 

MOBE FBOM AMALGAMATED BANKINGS 



Testbooka apparently •v^nmphagiM the importanee of Diaplaeement 

Howe 18 placei 

Clinton 8.6 " 

ComwalUi 8 " 

J. E. Johnaton 6 ** 

Burgojne 4 ** 
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Sheridan 8 

Meade 7.6 " 
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SECTION n 

A SYMPOSIUM ON THE PURPOSES OF HISTORICAL 
INSTRUCTION IN THE SEVENTH AND EIGHTH-GRADES 



B7 J. Q. Dealej, C. A. Ellwood, E. B. Greene, A. B. Hart, W. H. Mace, Dayid 

Snedden and an Anonymous Contributor 
Introduction and Summary by W. 0. Bagl^ 



INTRODUCTION 

Studies of minimal essentials in American history have ap- 
peared in the reports of the Committee on Economy of Time pre- 
sented in the Fourteenth Yearbook and Sixteenth Yearbook of this 
Society. These studies have hitherto been limited to problems that 
were susceptible of empirical treatment, and have been concerned 
chiefly (1) with the actual content of seventh-grade and eighth- 
grade instruction in American history as this is revealed in the 
textbooks, and (2) with possible deficiencies in the present-day con- 
tent as these are revealed by the demands which current literature 
of various types may be assumed to make upon the historical in- 
formation of its readers. 

The symposium presented in the following pages attacks the 
problem of minimal essentials in history from a quite different 
point of view. It represents an attempt to formulate aims or ob- 
jectives for the teaching of elementary history, and to evaluate 
current aims and objectives. Not what is but what ought to be is 
the point at issue here — and not ''what ought to be" as determined 
by a circumscribed examination of a particular need (such as the 
need for historical information in interpreting current literature), 
but ''what ought to be" from the point of view of realizing na- 
tional ideals. 

In arranging for this symposium, a letter was sent to twelve 
men: one philosopher; four historians prominent in the field of 
American history; two sociologists; two specialists in the teaching 
of history ; one professional student of education whose chief inter- 
est is in the sociological foundations of education ; one superintend- 
ent of schools who is also a student of history; and one business 
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man who has been interested in the influence of elementary history 
upon national ideals. 

The seven contributions printed herewith were received in 
response to this letter^ the essential parts of which follow : 

''The Committee of the Department of Superintendence on Economy of 
Time in Elementary Education has asked me to organize a symposium on the 
possibilities and present weaknesses of the instruction in American history 
now given in the upi>er grades of the elementary school. In view of the large 
influence that this initial study of our country's history must have in shaping 
o<ar national ideals, the committee believes tiiat the tune is opportune for a 
thorough-going discussion of the aims and objectives that should govern the 
content and t£e spirit of the instruction. As at present constitute, the ele- 
mentary work in history is generally regarded as having for its purpose the 
development of ''good citiz^iship" and especially the inculcation of patri- 
otism. It has been and is still concerned primarily witii our political and mili- 
tary history, although tiiere has been a tendency in the past two decades 
to give a larger emphasis to social, industrial, and economic development. 
The question in the minds of the members of tiie committee is whether the 
beving of this elementary study of the national history upon good citizenship 
cannot be more adequately defined. What specifically should this basic work 
attempt to accomplish and what changes in the content and spirit of the in- 
B^ction are essential if the desired ends are to be attained! ' ' 
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J. Q. DEALEY 
Professor of Social and Political Science, Brown University 



In this symposium my interest is concerned more with the 
'* possibilities" than with the ** weaknesses*' of the instruction in 
American history now given in the upper grades of the elementary 
schools. Believing thoroughly, as I do, in the need for a greater 
** economy of time in education," I would yet stress as of equal, 
if not greater importance the need of real efiSciency in teaching. 
Furthermore, instruction in the grades presumably can be given 
more effectively if the work of instruction and the content of the 
subject matter are both brought into relation with the larger edu- 
cation of the secondary schools and the college. 

I would therefore venture to suggest that efficiency in the 
teaching of history and economy of time in the grades depend 
largiely (1) on the personality and intelligence of teachers, and (2) 
on the freedom and initiative allowed these in determining the 
methods they use and the content of the subject matter they im- 
part, provided that there is a general understanding among the 
teachers of history as to the end to be attained through the instruc- 
tion they furnish. 

In respect to the first point I should assume that in general 
the average teacher at present in the grades, through lack of a broad 
education, is incompetent to give capable instruction in history. 
In place of these, those responsible for city or county systems of 
instruction should select a well-trained capable person and place 
him in charge of the teaching of history. This person should be al- 
lowed a voice in the selection of his assistants and should be held 
responsible for the efficient presentation of history in all the sec- 
ondary and graded schools of the city or county. Assistants should 
invariably be graduates of colleges, preferably with some training 
in education, and the importance of their work should be shown 
by the payment of proper salaries. The several heads of instruc- 
tion in history within a given state, in connection with an advisory 
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committee selected from the departments of history, economics, 
politics, and sociology of neighboring colleges or universities, should 
be required to meet monthly or bimonthly for purposes of discus- 
sion in respect to problems of teaching, both as to content and 
as to method. Under some such system as this the importance of 
the teaching of history would be emphasized and instructors would 
be stimulated to 'make good,' so as to win reputations as capable 
teachers, and consequent promotion. 

As to the second point, it would seem unwise to require cap- 
able and intelligent teachers to confine themselves to stipulated 
textbooks, or to routine methods of instruction. An intelligent 
teacher of good personality is a better source of instruction than 
nine tenths of the textbooks now in use. In the classes in history 
it might be well for instructors occasionally to prepare simple lec- 
tures on the subject matter, so as to train the ear of the pupil 
as weU as the eye, and also to begin instruction in the taking of 
notes from lectures and from a minimum of carefully selected read- 
ings. History in this social age should no longer be confined pri- 
marily to political and military history, but should include the 
essentials of social evolution, stressing the development of man 
and his achievements, in addition to the development of the nation. 
In this transitional century of world history, teachers should be 
allowed large discretion in method and content, so as to allow a 
varying emphasis according as social, economic, national, or inter- 
national interests are uppermost in men's thoughts. The pupils 
of course must master the important details of civic organization, 
structure, and function, but the real object of each teacher should 
be to arouse interest in the larger affairs of national and interna- 
tional life as well as in the activities of local environment. In 
addition, he should aim to explain to his pupils the inter-relation- 
ships of human society, to develop an appreciation of the social and 
political ideals of progressive nations, especially those on the West- 
em Continent, and, as an aid in this, to have them become familiar 
with the names and lives of great achievers in national and social 
progress. He should also be able to explain, as opportunity offers, 
the importance of some past or new invention or scientific discov- 
ery, or some great achievement in national culture. Especially 
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should he be capable of explaining simply the principles of Amer- 
ican democracy, such as those underlying a federation, the written 
constitution, the party system, and a citizen's rights and obliga- 
tions. Obviously, instruction in the grades must be simpler than 
in secondary schools, yet the distinction should be chiefly in quan- 
tity, not in quality ;for, after all, the finest and best of human knowl- 
edge can be comprehended by children as easily as by adults. 
Since relatively so few children pass from the grades to higher 
education, it is surely the height of absurdity tot a nation to allow 
the great mass of its future citizens to enter economic life without 
a gleam of national hope and aspiration. Probably if interest in 
such matters were aroused in graded schools, a far larger number 
would enter the schools of higher education, so as to become familiar 
with the movement of national and international politics and with 
the steps in social progress. 
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CHABLES A. ELLWOOD 
Professor of Sociology, University of Missouri 



In my opinion the aim of teaching American history in the 
elementary schools should always be '*good citizenship.'* This, to 
be sure, should be the general aim of the whole curriculum, but 
in the teaching of the social studies, such as our national history, 
it should be especially emphasized. I mean by **good citizenship'' 
not simply the making of intelligent voters, desirable as that may 
be, but the fitness of the individual for community and national 
service on the broadest human lines. I should hold it to be es- 
sential to good citizenship, for example, that the individual be a 
good friend and neighbor, a good father or mother, an efiScient pro- 
ducer and a wise spender, as well as loyal to his country. To be a 
good citizen, in other words, one must share fully in the national 
consciousness, that is, in the ideas and ideals which have guided 
the past development of our nation and which we set up as the 
goals of its future development. 

I should deprecate the teaching of 'patriotism' in any formal 
sense in the study of American history. Rather, the child should 
be taught loyalty to the great ideals for which our nation has stood ; 
patriotism will then take care of itself. Our whole national history 
should be presented to the child as a struggle to realize certain 
national ideals. The child should be taught to look upon American 
history as a movement to realize an ideal society founded upon ideas 
of liberty, justice, and brotherhood ; to appreciate that the failure 
of our nation to realize these ideals would mean an irreparable loss 
to humanity as a whole; and finally to feel that on this account 
the great lesson for the individual to draw from American history 
is that he should consecrate himself and all of his powers to the 
realization of these ideals. 

The study of human culture has shown us that all cultural and 
group life develops about certain 'pattern ideas.' These 'pattern 
ideas' in American history may be briefly summed as those of 'dem- 
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ocracy,' 'national unity,' 'material success,' 'social justice,' and 
'the service of humanity.' The first three are found throughout 
our history; the last two have come to prominence within the 
past two or three generations, but were doubtless implied in the 
first three tipm the start. Democracy, in the sense of political 
democracy, or self-government, should be shown in the teaching of 
American history to be one of the earliest ideals for which the col- 
onists and the fathers of our republic stood. In more recent times 
the effort has been to purify this democracy and make it practicable 
as a form of government in large and complex populations. To 
do this we have been gradually brought to realize the necessity of 
developing more complete democracy in our social relations and 
even in our industrial life. 

From the early days of our Revolutionary War, national unity 
has been one of the 'pattern ideas' which our nation has sought 
to realize. To realize this idea the Civil War was fought, but 
not until the Spanish War did the sense of national unity come to 
pervade and dominate the whole nation. But during the present 
war it has again become manifest that we have not realized this 
ideal in its full measure, and our efforts are now being directed to 
inculcate like-mindedness, harmony, and fraternity among all ele- 
ments of our population. 

As soon as national unity was realized, the conquest and de- 
velopment of the material resources of our continent began to ab- 
sorb the energies of the American people. At first, this energy was 
directed toward the settlement of the West and the opening up of 
agricultural and mineral sources of wealth. Later, mechanical in- 
vention was developed as a new method of harnessing natural 
forces and achieving material success. Still later, scientific and in- 
dustrial education came to be emphasized as the means of attain- 
ing the highest national efiSciency in material and economic lines. 

This exploitation of the material and economic resources of the 
country was largely directed, at first, in an individualistic way, 
that is, to the end of ' private profit. ' This led to the exploitation 
of class by class, and to social injustice. Hence arose the demand 
for social justice as between classes, which first manifested itself 
in our history in the consideration of the status of the negro slave. 
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A great part of the political history of the nineteenth century cen- 
tered around the securing of social justice to the negro. Later, 
the securing of social justice to our working classes generally be- 
came, especially in the early years of the twentieth century, the 
dominant concern of our politics. This is perhaps still the chief 
note in our internal politics during the present war, and we now 
realize that social justice must extend even to the immigrant laborer 
among us. 

Throughout our history, perhaps, there has been more or less of 
the ideal of service to humanity in our struggle to secure liberty, 
justice and fraternity ; but this ideal became manifest only during 
the Spanish War, when altruistic motives led the majority of our 
people to favor intervention in Cuba. During the present World 
War the same ideal has led us finally to interfere in the struggle 
in Europe and to see that we cannot establish liberty, justice, and 
fraternity for ourselves unless we help to establish them also for 
all the nations of the world. 

This outline is not offered in anything more than a tentative 
way, and only to illustrate the spirit in which I would wish to 
have American history taught in our public schools. It should be 
taught, in other words, so as to inculcate the ideals of good citizen- 
ship and to give insight into the social and political problems with 
which our nation has grappled from the beginning and with which 
it is still grappling. Of course, errors and blunders in our history 
should not be overlooked, as the child may often learn the lessons 
of good citizenship from these more effectively than from our suc- 
cesses as a nation. Our history should teach humility as well as 
loyalty and devotion to national ideals ; it should be especially made 
to emphasize the necessity of greater intelligence and good will on 
the part of the citizen as he deals with the increasingly complex 
social, political, and economic problems of our national life. I 
should favor teaching history in general, therefore, from the ' prob- 
lem' point of view, and the more concrete and 'up-to-date' the 
problem can be made for the child, the better. I should certainly 
not favor teaching our history as a sequence merely of important 
dates and events. Concerning the pedagogical details necessaty 
to the working out of a practical course in American history taught 
from the above point of view, I do not feel competent to offer an 
opinioiL 
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In any discussion of history in the general scheme of pnblic 
education, we must face squarely an important difference in point 
of view between the historian as man of science and the educational 
administrator or public school teacher who is responsible for the 
training of young people for citizenship. The former is primarily 
concerned with the ascertaining and disseminating of accurate 
knowledge with regard to the subject matter of his science ; the lat- 
ter thinks first of the effect of this body of teaching upon the intel- 
lectual habits and outlook of the pupil. Does this difference of aim 
imply a difference of attitude so serious as to prevent cooperation 
between the two groups of workers f Has the scientific historian 
anything to offer to the man who is primarily concerned with the 
formation of a rational type of patriotism f 

Most historical scholars have had misgivings about the associ- 
ation of history with patriotism. The so-called 'patriotic' teach- 
ing of history has too often nourished Chauvinism and developed 
the most extreme forms of national self-conceit The possibilities 
for evil of this method have found in Prussian schools an abschreck- 
endes Beispiel which is not likely soon to be forgotten. Against 
this sort of 'patriotic' history, the scientific historian has protested 
and must continue to protest with all his might — ^the more so be- 
cause the ostrich habit of refusing to look the facts squarely in the 
face is scarcely less futile for the patriot than for the scholar. 
Some distortion or coloring of our vision by emotional factors of 
one kind or another can hardly be avoided, but let us get as near 
as we humanly can to seeing things as they really are and have 
been. 

Undoubtedly, then, the association of patriotism with science 
in the teaching of history is beset with difficulties that are real and 
serious — so serious that many scholars take refuge in a kind of 
monastic detachment from the 'dust and heat' of contemporary 
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problems. Not all students of history, however, are satisfied with 
this '^ fugitive and cloistered virtue." For some of them at least, 
the perversion of historieal material by misguided patriots is a dan- 
ger to be guarded against, but not a sufficient reason for abandoning 
the field. They are not disposed to find in history hard and fast 
maxims applicable to all times and places ; they realize the extreme 
complexity of any great historical event or movement and the fu- 
tility of many analogies which seem plausible enough on the sur- 
face. But when all is said and done, they are ready to do what 
they can to make the facts of history, scientifically ascertained and 
sincerely interpreted, serve the uses of an intelligent patriotism. 
How this may be done is a problem requiring for its adequate dis- 
cussion much more space than is here available, but a few sug- 
gestions are offered with some reference to the particular crisis 
through which we are passing. 

It seems safe to say, first, that 'historical-mindedness' is in it- 
self a valuable asset for the citizen and for the nation. We may 
define that attitude in various ways, but perhaps its most important 
element is the consciousness in the individual of his membership in 
a continuing community. The historically-minded person, young 
or old, is the one who feels his comradeship, not only with those who 
share with him the conmiunily life of the present, but scarcely less 
with those who in the past have built up the social fabric of which 
he is a part, and with those others, yet unborn, whose life must de- 
pend in some measure on what he and others like him are do- 
ing today. Something of that historical vision there must be in 
every citizen who, with a reasoned patriotism^ deliberately gives 
up his individual life in defence of his country, and its ideals. 
Indeed, the strength of any nation must depend in large 
measure upon the proportion of its citizens who realize this 
essentially historical conception of their part in a continuing 
community as something more important than their individual for- 
tunes. Here, surdy, is common ground where history and patri- 
otism may meet without disloyalty to the ideals of either. 

In all this there is no question of twisting facts to bring out 
the virtues of a reigning dynasty, or a dominant party, or even of 
one's own country. Indeed, the rationally patriotic teacher of 
American history should be more concerned than any other to read 
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the record straight — to find in its failures and blunders, no less 
than in its successes and achievements, an infinite variety of sugges* 
tions for the problems of contemporary life. It happens, for in- 
stance, that we are now involved in war, a war radically different 
in many respects from any in which we have ever before been en- 
gaged ; and yet it has already brought to the front certain funda- 
mental issues which have been illustrated in our previous experi- 
ence. We find ourselves almost irresistibly recurring to the ex- 
periences of Washington in the Revolution and of Lincoln in the 
Civil War for precedents to be followed or mistakes to be avoided. 
What has our experience shown as to efficient and inefficient ways 
of raising soldiers, as to sound and unsound methods of financing 
war, as to the variety of ways in which civilians, young and old, may 
help or hinder the national cause f It is not necessarily true that 
methods which proved mistaken in the past may not succeed under 
new conditions in the future ; but experience is at least suggestive, 
as in the case of Washington's trials with the militia, or of paper 
money experiments in the Revolution and the Civil War, and may 
at least save us from a thoughtless stumbling into obvious pitfalls. 
American biography should be dealt with in a similar spirit 
The one-sided idealization of our historic leaders has often provoked 
modem writers to extreme reactions in the opposite direction. 
Even with young pupils it ought to be possible to show that great 
personalities like Franklin and Jefferson and Hamilton, are not 
to be explained by the simple formula of hero-worship, at the one 
extreme, or the scarcely less over-simple formula of economic de- 
terminism, at the other. The proper teaching of American history 
in the schools ought to help the young citizen to see that a really 
great leader may make unlucky mistakes, as Abraham Lincoln did 
when he appointed his first Secretary of War, or when he commis- 
sioned certain ** political brigadiers;'' that the hasty judgments 
of contemporaries may prove to be mistaken, as when in 1864 a 
large proportion of Lincoln's own political associates were con- 
vinced that his administration had been a failure. If teachers can 
set people to thinking along these lines, it will help to make them 
fairer, more discriminating critics of the men for whom they will 
have to vote. 
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One last suggestion is offered, with fall appreciation of the 
difficulty of carrying it into effect. The events of the past few 
i^onths are gradually convincing the American people that even 
iur great Republic of the West is vitally concerned in the move- 
mients of the old world. As a matter of fact, our connection with 
Europe — ^the European element in American history — has always 
jbeen much more important than the textbooks would lead us to sup- 
/pose. The predominance of English speaking people in America 
/was the result of a great conflict in which the genius of William 
-^ Pitt and the armies of Frederick the Great were important factors. 
We owed our success in the struggle for independence in large 
part to the desire of Prance and Spain to restore what seemed to 
them a better political equilibrium in Europe, and more particu- 
larly, we owed it to our alliance with Prance. Our Declaration of 
Independence and our State constitutions with their insistence on 
government by "the consent of the governed" gave new courage 
to the radical thinkers of Europe and were among the many influ- 
ences which inspired the great revolution in Prance. The Louisi- 
ana purchase and the Monroe doctrine, the declaration that Amer- 
ica at least must be "made safe for democracy," can not be under- 
stood without some notion of European history. The same is true 
of the great movements of immigration which have changed so rad- 
ically the character of our population. It is equally true that the 
historic ideals of America cannot be fully appreciated without com- 
paring them with those of a liberal parliamentary government like 
that of Great Britain or an intensely monarchical and aristocratic 
oystem like that of Prussia. In the face of our new international 
problems, the restricted outlook of our older teaching has become 
not only undesirable but dangerous. 
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How did American history come to be almost a universal study 
in the schools of the United States? It was the Ajnerican Revolu- 
tion which fired the imagination of the people and led to the writ- 
ing of the earliest textbooks. They were based chiefly on the storj" 
of the colonial settlements, the virtue and prowess of the men of 
the Revolution, and the story of the American Indian. Later the 
War of 1812 and the Mexican War were added to the course of mil- 
itaiy glory and invariable victory, and then some of the political 
history became attached to this mainly military view of the things 
significant in the United States. The Civil War emphasized for 
the next generation the military side of our history. Not till about 
1890 did school textbooks strive to awaken a major interest in the 
arts and events of peace. 

Textbooks prepared upon such a basis no longer answer for 
the needs of the schools. Even in the midst of war the attention 
of the nation is directed to the resources, transportation, manu- 
factures, finance, industries, and agriculture of the country; and 
to the problem of drawing out the man-power, woman-power and 
child-power of the nation. Problems of immigration, citizenship, 
labor, and social organization press upon every thinking mind. If 
the schools are to perform the task for which they are created, that 
of helping to put into children's minds a sense of the vital forces 
of the republic, and of how the people have worked out a society 
and government which make national existence possible, textbooks 
of history must deal with the things that have made the nation 
what it is. 

To this end a history that is principally a reading book does 
not contribute the requisite structure: every school book ought to 
be as readable as the nature of the case allows, but anyone who has 
ever gone through such delightfully easy and readable books as 
Green's English People and Piske's Discovery of America realizes 
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that a history may be fatally fluent when used by young people. 
A textbook of American history is for many children their only 
contact with the story of their own country, and the make-up must 
be such as to fix the attention. Devices of print, numbered sec- 
tions, and indicated sub-divisions of sections, are a help to the 
learner and an aid to the teacher in the highly important task of 
ascertaining whether the child's mind has really appropriated the 
sense of the book. 

The modem textbook ought to have a good outfit of pictures 
and maps. This is a picture age. Monthly, weekly, and daily pa- 
pers overflow with pictures. A good part of popular education is 
absorbed from the 'movies;' but textbook illustrations ought to be 
largely of real things, which add clearness and life to the text. 
Maps are pedagogically still more important, for they are graphic 
means of telling important things in a parallel language. 
The proper use of accurate, well-distributed, and appropriate maps 
makes a clear addition to the text, and helps to build up in the 
child's mind a sort of skeleton map which will be serviceable 
throughout life. 

The good textbook should recognize the fact that some schools 
have, and will use, additional historical material, and should there- 
fore contain serviceable chapter bibliographies, condensed and care- 
fully selected. Lists of topics or questions are a reasonable con- 
cession to the busy teacher who finds them an aid in class work. 
In fact every convenience that the textbook writer can introduce 
within the limits of his book goes toward augmenting the teaching 
power of the teacher. 

The most serious question in textbooks of American history 
is their content : and every writer of such books discovers that he 
must leave out a great number of things which are interesting in 
themselves and helpful for an understanding of the progress of 
American history. In this process of rigorous and often painful 
selection, the writer ought to keep in his mind the following guid- 
ing ideas. 

(1) The personal element must not be left out at any stage. 
Men like Franklin, Washington, Lincoln, Cleveland, are gifts to 
mankind; important not only for what they have said and done, 
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but also becanse they represent the highest reach and aim of their 
time. 

(2) Military events and movements should be decreased to 
small compass. The really important thing in all wars is not the 
battles but the effort of the nation to rise to the crisis, to go tliirongh 
such tremendous experiences as are now upon the people of the 
United States. 

(3) Politics and parties can be strung on a chronological 
wire, of which the supi)orting posts are the presidents and other 
recognized leaders ; but party struggles, except so far as connected 
with questions which are still vital, are far less significant than 
other elements in the nation's history. 

(4) The social life of America at various epochs is interesting 
in itself and serves to keep in mind the essential idea that American 
history in past times has been carried on by much the same kind 
of people as today. 

(5) The history of the separate states is good each for its 
own community; but all school children should realize that the 
Union has been made up of geographic sections: New England, 
the Middle Colonies and States, the South, the West and the Far 
West. True history must keep account of the relations and the 
rivalries of these sections. 

(6) The actual United States is not a region, but a group 
of a hundred million people. No history does its duly that does 
not bring out the race elements, the social organizations, the dis- 
tribution of population, and especially the immigrants and re-emi- 
grants. 

(7) The economic life of the people is made up of the extrac- 
tion of the fruits and the mineral bounties of the earth, and their 
combination into things useful for mankind ; hence a school history 
must contain an account of the growth of knowledge and of pro- 
cesses, of new industries, of methods of transportation, of conser- 
vation of the gifts of nature. 

(8) In the present world of enormous combinations of busi- 
ness and labor, it is imperative that even children should under- 
stand something of the increase of capital, the great aggregations of 
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wealth, and the means of keeping a balance between the interests 
of capital and labor. 

To interweave these descriptive matters with the thread of con- 
secutive history and the succession of events is a hard task ; but he 
who cannot fit them together into some kind of unity, into a book 
which can be read with some pleasure and some advantage, and 
which will serve as the basis for classroom work, may as well aban- 
don his pen, for that is what America is doing, and a knowledge of 
it is what the schools must have. 
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The content of history for these grades should deal with great 
historical characters and with historical events. Emphasis should 
be distributed as follows : upon great characters for Grades IV and 
V, upon events for Grades VII and VIII, and about evenly divided 
for Grade VI. 

The thing that most profoundly stimulates interest and char- 
acter is the moral content of the individual's action. This moral 
or ethical side appears in the hero's struggle against obstacles and 
his victory over them, whether the difficulty be political, social, or 
economical. The story, whether oral or written, must set out these 
conflicts in a clear and sticking way. The son of the well-to-do will 
admire Lincoln's conflict with ignorance and poverty and his vic- 
tory over them, while the son of the poor will catch hope from the 
results of this struggle. His battle with Douglas was almost en- 
tirely a political one, but the moral contrast displayed by the two 
men has great lessons. The struggle of Thomas Edison to achieve 
distinction is a fine illustration in the industrial field. His strug- 
gle against poverty when a newsboy and a wandering telegraph op- 
erator will stir sympathy, and his great achievements will stimulate 
endeavor. 

These illustrations are given to show that present-day study of 
history is not all of war and politics. And while the number of 
stories dealing with purely economical characters should be in- 
creased, the danger is of plunging into a field which bears the title 
of popular clamor, but which falls far short of giving a great moral 
uplift to the pupil. Perhaps the result would not be so disastrous 
in the new field if our teachers were more thoroughly trained to do 
their work. This work may be worse than failure. If it is dry and 
uninspiring, it may result in creating a dislike for the subject. 

The purpose of the fifth year is to give some notion of European 
history with particular emphasis on the beginnings of American 
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history. The pnpil is now ten years old; for this reason and for 
the fact that he has given two years to the story of men and women 
who have done great things, he is able to take history in a more 
complex form. In this new phase he is able to look at history in 
which the great man is beginning to disappear; in which he is still 
a leader but only a leader. As he approaches the end of the fifth 
year, the leader merges himself into the action which we call an 
event. 

In Grades VII and VIII the emphasis is upon the event — an 
action in which our leader may be one of many. The effort is to 
make the pupil see the action of people. If the teacher is skilled 
in her work, the pupil will be able to look upon the leading events 
of these two years as if he had been a part of them — as if he had 
participated in them. 

This vividness may extend to industrial and economic as well 
as to political history. Here in these last years of the grammar 
school we have a wider range of events from which we can select. 
And there is no particular reason why they should not be chosen 
from industrial history so as to even up our once somewhat one- 
sided course. 

The economic history is more abstract — especially in its finan- 
cial aspects — ^than other historical facts. In order that the history 
may live and attract it should be concrete from start to finish. 
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1. The important and practicable specific aims of public sdiool 
education for boys and girls from ten to fifteen years of age include, 
along with others relating to physical well-being, cultural develop- 
ment and moral training, several aims which have primarily in view 
good citizenship, in a somewhat restricted and therefore workable 
sense of that term. But at present very little of the direct instruc- 
tion and training given to pupils of the ages indicated demonstrably 
functions as education for citizenship. We can readily assume that 
thd discipline of the school, the personalities of teachers and prin- 
cipal, and the varied self-initiated group-activities of the pupils 
themselves, all contribute indirectly, or thru their educative by- 
products, to good citizenship. But only by vigorous use of the im- 
agination can we assume that geography, grammar, literature, arith- 
metic, manual training, music, and the other school subjects as they 
are now taught, make appreciable contributions to the qualities 
(specific, habits and habitual attitudes, appreciations, varieties of 
insight and understanding,, ideals, active motives) that we should 
easily identify as characteristic of ^good citizenship.' 

It has been commonly taken for granted that some 'knowledge' 
of American history is essential to good citizenship ; and, as a re- 
sult, American history, as a 'subject of study' for children from 10 
to 15 years of age, has attained a large place in elementary school 
curriculums. The 'content' of the subject, as commonly taught, 
is quite accurately exhibited in the textbooks generally used. This 
content, for Grades four to six, is usually made up of easy narrative, 
story materials, and biographies. For Grades seven and eight it 
consists of very condensed statements of detailed fact and generali- 
zation, presented in rigid chronological order, and with substantially 
no cross reference to contemporary conditions and problems. 

2. It is submitted that any serious attempt to evaluate the 
results of the teaching of this American history by all but a bare 
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fraction of teachers (one in a thousand having native genius suffi- 
cient to reorganize the subject in process of teaching it) will result 
in the conviction that such teaching has no substantial functional 
value for the rank and file of pupils (exception must again be made 
for the rare genius) in laying foundations of good citizenship as 
these may be expressed in terms of habit, appreciation, under- 
standing, ideal, or motive. This failure may be ascribed to many 
causes: To emphasis on political and military history sufficient 
to exclude those topics and considerations which are of most con- 
cern to the average citizen; to multiplication of highly digested 
statements of data and conclusions, irrespective of their interest 
or pertinency ; and to inclusion and elaboration of topics with no 
reference to their bearing on civic problems of the present or future. 
But most of all must it be ascribed to the probable impossibility, 
under any circumstances, of using the materials of history, when 
organized on the bases approved by the historian, as useful means 
of civic education. History, for the purposes of the historian (and 
perhaps also the purposes of the student pursuing it from cultural 
motives) must be organized largely on a chronological basis; the 
inclusion of topics and emphasis thereon must be determined largely 
by their significance to thei societies of the past times in which the 
events occurred; and the 'unity' of the subject (as alleged, but of 
course hardly ever realized in textbooks) must be preserved. 

But the 'problems' of the citizen are of today or tomorrow; 
and when in the case of any problem, historical perspective is essen- 
tial to its understanding, the importance of the strand of history, 
rapidly tapering to a point in the past, which is required for the 
purposes of such perspective usually bears no relation to its impor- 
tance in historians' history. For example, the struggle of the French 
and the English for x>ossession of large portions of North America 
necessarily looms large to the historian ; but rarely, and then only 
incidentally, does it affect understanding of contemporary problems 
of citizenship. Conversely, problems of transportation of commod- 
ities, which in a hundred ways confront and baffle all good citizens 
today, havei practically no history that is illuminating and sugges- 
tive back of 1840. Examples could be multiplied. 

3. As a basis for discussion, the thesis is here submitted that 
American history, as commonly organized, should be employed in 
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the civic education of youths 10 to 15 years of age, primarily as 
reference material only. It should not be stvdied — ^that is analyzed 
intensively, interpreted, and memorized — except in just sufficient 
measure to make the use of its materials for reference purposes easy 
and effective. Probably the equivalent of twenty hours study in 
each grade from the fourth to eighth would be sufficient for these 
purposes. 

The time and energy now given to the study of history should 
hereafter be devoted to a study of those topics which obviously have 
contemporary and future significance for citizenship, and, where it 
is evident that the events and ideas of the past can, for the learners 
under consideration, contribute to understanding of these problems 
and to the formation of ideals, the historical materials should be 
made accessible and, to the extent necessary, studied. In the case 
of almost any topic meeting the conditions here suggested, it will be 
evident, of course, that only certain aspects or elements can profit- 
ably be studied by pupils of stated degrees of development. For 
example, the immigration, education, and assimilation of non- 
English-speaking foreigners to this country embraces many prob- 
lems of the| utmost significance to all citizens. Some of the phases 
of these problems can readily be grasped by pupils of ten years of 
age whose parents were themselves immigrants or who have been 
closely associated with immigrants. Other phases of these prob- 
lems, including much of the interesting history of immigration in 
the 17th, 18th, and 19th centuries (and also of Flemish migrators 
into England, of barbarian into the Roman empire, and even of 
earlier legendary migrations) can well be apprehended by pupils 
of the seventh and eighth grades. 

The perennially strained relations of labor and capital, the 
'cleaning up' of cities, the further development of agriculture, the 
stabilizing of our public fiscal affairs, the occupation and develop- 
ment of public lands, mines, and water-power opportunities, the 
improvement of transportation, the development of right interna- 
tional relationships, the further evolution of suffrage and right 
methods of voting, the regulation of business in vice-producing com- 
modities like alcoholic beverages — all these and a hundred other 
similar topics in their non-partisan aspects are certainly no more 
difficult than the topics which pupils are forced to study as Amer- 
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ican history — and certainly many times more profitable as prepara- 
tion for intelligent citizenship. 

Some, devoid of sense of hnmor or of the sweet ¥dsdom of prac- 
tical experience, will still murmur ''But how can youths under- 
stand these questions if they do not know history f ' ' Would these 
critics insist that before youth can partly appreciate and partly 
understand the ''flower in the crannied wall" it must first under- 
stand " what God and man is T ' 
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vn 



(Bj a Contributor Who Wiahed to Have His Name WitUield) 



I am impressed with the fact that altogether too much attention 
is paid to the separate historical development of a separate country, 
and too little attention paid to the events which, at the same time, 
transpired in others, which have had a determining influence on the 
one country whose history is being studied. In my experience in 
active life, I have found a few men particularly weU equipped — 
intellectually — ^who had been given, in school, a picture of what had 
occurred at a given period in all European countries, for instance. 
They knew how to place prominent persons and facts in their rela- 
tion to one another, had a dear impression of what influences had 
been active in countries adjoining each other, and knew thereby the 
essential features of history much better than others who had been 
taught by the usual method. I must confess that I have met few 
who had had the benefit of what seemed to me the preferable 
method, but the impression made on my mind must have been so 
much the more emphatic ; it has dung to me for years. 

I think too, thal^ while nationalistic teaching of history is to a 
certain degree necessary and desirable, children should be taught 
that above all consideration for one's own country, there is the obli- 
gation to direct public policy and acts according to '^a decent re- 
spect to the opinions of mankind," and that this consideration 
should supersede all sdf-interest, under all drcumstances. It 
should, in my opinion, be pointed out as the theory which permits 
full and free action of separate political units, without requiring 
"internationalism" as a safety valve. 
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BUMMABY 



W. C. BAGLEY 



From these discussions it seems safe to infer that the most sig- 
nificant weakness of history as now taught and studied in the ele- 
mentary school is the narrowness of its scope and content. Our sud- 
den transition from the x)osition of a sequestered and perhaps some- 
what self-satisfied nation to a position' that in many ways lays upon 
our people the responsibilities of a world-leadership indicates clearly 
the need of an understanding of our national development in the 
light of preceding and parallel movements in Europe. 

At the same time, the contributors to this symposium are appar- 
ently in agreement that elementary history has still an important 
function to discharge in the development of a true patriotism. But 
the qualifying adjective is important. The care with which they 
havQ formulated the conception, of patriotism testifies to their belief 
that the older conceptions need some measure of reconstruction. 
Certainly that kind of patriotism that can be nourished only on 
deliberate misstatements and misinterpretations of historical facts 
is not the kind that a great democracy can afford to cultivate. 

Especially important in this connection is the wholly admirable 
suggestion that the teaching of national history should develop not 
only a national consciousness, but also a national conscience — a col- 
lective sensitiveness to dishonor in international relationships com- 
parable in every essential way with the sensitiveness to dishonor in 
personal relationships which constitutes the backbone of individual 
morality. It is the lack of this national 'conscience' in our present 
enemy that disgusts and repels us when we contemplate his atroc- 
ities, and one of the first points of agreement in the coming federa- 
tion of nations might well be an insistence that every nation through 
the instruction in history offered in its lower schools should take 
steps to develop this collective conscience. As some of these writers 
clearly point out, this is not an impossible function for the teaching 
and study of history to fulfill. 

Closely related to this, and particularly important in a democ- 
racy, is the suggestion that history, if taught aright, can make the 
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future citizen a ''fairer and more discriminating critic of the men 
for whom he will vote." Indeed, when we think of the responsi- 
bilities that the American people must assume in the new world 
order, it is hard to overestimate the fundamental importance of this 
aim in the teaching of history. A democracy must have its leaders, 
but the very essence of democracy lies in the fact that this leader- 
ship must be constantly subject to evaluation by all of the people. 
Certainly no school subject is so well adapted as is history to de- 
velop upon a broad scale this discriminating attitude of mind 
through which alone the perils of cheap politics and demagoguery 
may be avoided. 

It is apparent, too, that there is need for a broader aim for his- 
torical instruction than is indicated by the older implications of the 
formula, "Training for citizenship." The citizen is more than a 
voter, as practically all of our writers insist. There is need for an 
understanding and appreciation, not only of our political develop- 
ment, but also of our industrial and economic development, and 
there are present problems and clearly predictable future problems 
in the solution of which the perspectives and backgrounds which 
historical study alone can furnish may be and should be determining 
factors. While the conviction of one of the writers that the study 
of history in the elementary school may best be comprised in a 
series of references suggested by the study of present and future 
problems represents an extreme position, there can be no contro- 
versy over the importance of making a much larger use of the 
'problem' than we do now, and of training even the elementary pu- 
pil to search for causes and to view present problems in the light of 
their genesis. This, we take it, is the essence of that "historical- 
mindedness" which is listed as one of the desirable outcomes of 
historical study. 

Every discussion of aims and values in the teaching of history 
reveals a serious handicap under which the teacher of this subject 
must do his work. We refer to the diflSculty of formulating the 
outcomes of teaching in a way that clearly suggests both a method 
of procedure that will insure these outcomes and a reliable test of 
the efficiency of the teaching. The teacher of elementary arithme- 
tic, by way of contrast, can define the desired outcomes of his sub- 
ject in terms very largely of skill, and likewise the teachers of writ- 
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ing, spdling, oral and written composition, and the beginners' 
courses in foreign languages. But skill in this narrower sense is 
certainly not what the teacher of history is seeking to develop. It 
will be noted that our contributors use two groups of words in de- 
fining their aims. One group includes such terms as loyalty, patri- 
otism, good citizenship, unity, brotherhood, justice, fairness, and 
the like. The other group comprises such words as habitual atti- 
tudes, interests, appreciations, insight, understanding, historical- 
mindedness, pattern-ideas, motives, and ideals. The words of the 
first group represent complex sociological virtues which are usually 
considered objectively. The words of the second group refer to 
things pfiychological, subjective, to mental states or processes. It 
is deai^ that the more remote objectives in the study of elementary 
history must be formulated in terms of the former group ; but what 
the teacher must do is to insure the immediate, subjective outcomes 
which in right combination will spell those more complex, sociolog- 
ical virtues. 

The continual recurrence of the terms ''ideals," "apprecia- 
tions," and ''attitudes," and especially the care with which one of 
the writers has constructed a list of the specific ideals which should 
emanate from the study of elementary history and the urgency with 
which another protests against traditional methods of instruction 
as utterly inadequate to engender these outcomes, suggests the im- 
portance of a clearer understanding of what these apparently im- 
portant things really are and how the processes of education may be 
turned toward their development. Concerning the objectives of 
historical teaching there seems to be little disagreement; upon the 
materials, too, there is substantial harmony; but between the ob- 
jectives and the materials there is a veriable terra incognita. 
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members, with the exception of voting and holding office, and shafi be exempt 
from the payment of dues. 

A person may be elected to honoiary membership by vote of the Sodety 
on nomination by the Executive Committee. 

Seo. 6. The names of the active and honorary members shall be printed 
in the Yearbook. 

Seo. 7. The annual dues for active members shall be $2.00 and for 
associate members $1.00. 

Abtiole IV 

Officers and Committees. — Section 1. The officers of this Society shall 
be a president, a vice-president, a secretary-treasurer, an executive committee, 
and a board of trustees. 

Sec. 2. The Executive Conmiittee shall consist of the president and four 
other members of the Society. 

Sec. 3. The president and vice-president shall serve for a term of one 
year, the secretary-treasurer for a term of three years. The other members of 
the Executive Committee shall serve for four years, one to be elected by the 
Society each year. 

Sec. 4. The Executive Committee shall have general charge of the work 
of the Society, shall appoint the secretary-treasurer, and may, at its discretion, 
appoint an editor of the Yearbook. 
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Beo, 5. A board of trustees eonsistmg of three members shaU be eleeted 
hj the Soeiety for a term of three jears, one to be elected each year. 

The Board of Trustees shall be the eustodian of the property of the So- 
detj, shall have power to make eontraets, and shall audit all aeeounta of the 
Soeietj, and make an annual flnaneial report. 

Sbc. 6. The method of electing officers shall be determined by the Soeiety. 

Ainou y 

PuhUoatiana. — ^The Soeiety shall publish The Yearbook of the NoHanai 
Society for the Study of ESueaiion and such supplements as the EzecntiTe 
Committee may provide for. 

AinoLi VI 

Meetings. — ^The Soeiety shall hold its annual meetings at the time and 
place of the Department of Superintendence of the National Education Aaao- 
dation. Other meetings may be held when authorised by the Soeiety or by 
the Executive Oonmiittoe. 

AinoiA Vn 

Amendments. — ^This constitution may be amended at any annual meetiii^ 
by a vote of two-thirds of voting members present. 
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MINUTES OP THE MEETING 

of the 

NATIONAL SOCIETY FOR THE STUDY OP EDUCATION 

AT KANSAS CITY, MISSOURI 

Monday Evening, February 26, 1917 

More than a thousand persons assembled in the Grand Avenue 
Temple to hear the discussion of the Sixteenth Yearbook of the 
Society. President Chadsey called the meeting to order and pre- 
sided during the f oUowing program of addresses : 

Progress in the Study of Economy of Time. 

H. B. Wilson, Superintendent of Schools, Topeka, Kanimii, 

Som£ Contributions to School Practice That We May Expect From 
Time Economy. 
B. G. Jones, Superintendent of SdioolSy Boekford, HI. 

A Critical Estimate of the Methods Employed in Determining Min- 
imoZ Essentials. 

L. D. CoFFMAN, Dean Ck>Uege of Education, UniTenity of Minneeotay 
Minneapolis^ Minn. 

Economy and Efficiency in Science Teaching. 

O. W. Caldwsll, University of Chicago, Chicago, HI. 

Use of the Syllabus as a Supervisory Instrument to Promote Effect- 
ive Training. 
E. Horn, University of Iowa, Iowa City, Iowa. 

Minimal Essentials in the Training of Teachers. 

W. C. Baoley, Director School of Education, University of Hlinois, 
Urbana, HI. 

After some discussion a brief business meeting of the Society 
was held. 

On recommendation of the Executive Committee and Board 
of Trustees, it was voted that the first sentence of Article IV, Sec- 
tion 3, of the Constitution be amended to read as follows: ''The 
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president and vice-president shall serve for a term of one year, 
the secretary-treasurer for a term of three years." 

It was voted to endorse the following resolution of the Execn- 
tive Committee: *'The National Society for the Study of Educa- 
tion will welcome the opportunity to enjoy the benefits of afiKli- 
ation with the American Association for the Advancement of Sci- 
ence provided this privilege can be extended to all persons who 
are members of the Society during the year 1917." The Executive 
Committee reported that it was considering the feasibility of ar- 
ranging a joint program with Section L of the American Associ- 
ation in 1918. 

The President announced that the Executive Committee had 
reappointed G. M. Whipple as Secretary-Treasurer of the Society 
for a term of three years. The rei)ort of nominations presented by 
the Executive Committee and Board of Trustees was heard and 
the persons cited were elected, as follows : 

For Presidsnt 

Lotus D. Coffman 

Dean, College of Education, University of Minnesota 

For Vice-President 

J. A. C. Chandler 

Superintendent of Schools, Richmond, Virginia 

For Trustee (to serve three years) 

George Melgher 

Director Bureau of Research and EfSciency, Kansas City, Missouri 

For Member of Executive Committee (to serve four years) 

Ernest Horn 
Associate Professor of Education, University of Iowa 

Charles E. Chadsey, President Guy M. Whipple, Secretary 
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FINANCIAL BEPOBT OF THE SECBETABY-TBEASUBEB OF THE 
NATIONAL SOCIETY FOB THE STUDY OF EDUCATION 

January 1, 1917 to Decbmbsr 31,* 1917, Inclusivb 

ebceipts fob 1917 

Balance on hand December 31, 1916 .- $2320.13 

From sale of Yearhoolca by the Univendty of Chicago Press, 
and the Public School Publishing Company: 

June to December, 1916 $ 610.86 

January to June, 1917 1242.62 $1853.48 

Interest on savings bank account: 

To January 1, 1917 $ 28.62 

To July 1, 1917 18.11 $ 46.73 

Dues from 882 members (current and delinquent) $1109.25 

Total income for the year $3009.46 

Total receipts, including initial balance $5329.59 

EXPENDITUBBS FOB 1917 

Publishmg and distributing Yearbooks: 

Printing 1200 15th Yearbook, Pt. Ill ("Junior High 

School") $ 361.96 

Printing 1300 additional 15th Yea/rbook, Pt. Ill 63.96 

Paper, alterations, stereo matrices and zincs for 16th 

Yearbook, Pt. Ill 277.67 

Printing 1200 copies 16th Yearbook, Pt. I ("Second 

Beport Economy Time") 575.01 

Printing 1800 additional 16th Yearbook, Pt. 1 114.48 

Paper, alterations, stereo matrices and zincs for 16th 

Yearbook, Pt. I 420.68 

Distributing 15th Yearbook, Pt. Ill and 16th Yearbook, 

Pt. I (sent together) 111.15 

Printing 500 additional 6th Yearbook, Pt. II ("Kinder- 
garten") 87.92 

Printing 750 additional 9th Yearbook, Pt. I ("Health 

and Education") 95.24 

Printing 500 additional 10th Yea/rbook, Pt. I ("City 

School as Conununity Center") 56.06 

Printing 750 additional 10th Yearbook, Pt. II ("Bural 

School as Community Center") 63.85 

Printing 750 additional ISth Yearbook, Pt. II ("Orga- 
nizing School Surveys") 77.07 

Printing 1200 16th Yearbook, Pt. II ("Size of High 

School and College Efficiency") 277.82 

Carried forward $2,582.87 
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Br<mght forward $2,582.87 

Papo^ alteratioiiB, stereo matrices and sines for 16th 

Yearbook, Ft. 11 140J59 

Printing 300 additional 16th Yearbook, Ft. II 28.76 

Distributing 16th Yearbook, Fart 11 50.70 

Distributing 16th Yearbook, Ft. I (since March 1, 1917) 18.40 
Packing, cartage, freight, transferring Yearbooks and 

otluir materials from Chicago Press to Public School 

Publishing Company 56.29 

Premium on ire insurance ($5,000) 18.75 

Total cost of Yearbooks $2891.36 

Secretary's Offloe: 

Secretary's salary from end of Detroit meeting, Febru- 
ary, 1916, to end of Kansas City meeting, February, 

1917 $ 100.00 

Secretary 's traveling and hotel expenses for Kansas City 

meeting 65M 

Bookkeeping and typewriting 72.75 

Other clerical assistance 17.50 

Stamps 56.80 

Stationery 86.00 

Telegrams L78 

Total for Secretary's office $ 340.76 

Total expenses $8232.12 

SUIOCABT 

Total expenditures for 1917 $8282.12 

Bri«»«, on h«.d December 31, 1917: ] ^I^gg "^S^i! ! "ZaT 

Total $5329.59 



Number of active members (including three honorary) De- 
cember 31, 1917 280 

Number of associate members December 31, 1917 602 

Total membership 882 

Gut M. Whipplx, Seeretary-Treamirer. 



ANNOUNCEMENT OF YEAEBOOKS AND EXPLANATION 

OF MBMBEBSfflP IN THE NATIONAL SOCIETY 

FOR THE STUDY OF EDUCATION 

The purpose of the National Society is to promote the investi- 
gation and discussion of educational questions. Anyone who is 
interested in receiving its publications may become a member. The 
Yearbooks are issued in several Parts each year and are discussed 
at the annual meeting, which is held in February at the same time 
and place as the meeting of the Department of Superintendence 
of the National Education Association. There are two types of 
membership, associate and active. Associate members pay $1.00 
annually and receive one copy of each Yearbook. Active members 
pay $2.00 annually, receive two copies of each Yearbook, and are 
eligible to vote and hold office in the Society. 

The Yearbooks deal in a practical way with fundamental cur- 
rent issues in instruction and school administration. The Sevens 
teenth Yearbook (calendar year 1918) will comprise Part I, to 
contain the ''Third Report of the Committee of the National Edu- 
cation Association on the Economy of Time,'' and Part II, to con- 
tain thirteen chapters on ''The Measurement of Educational Pro- 
ducts," prepared by the National Association of Directors of Edu- 
cational Research. Both Part I and Part II may be expected in 
February, 1918. 

Orders for Yearbooks for 1917 or earlier or for single parts of 
the Yearbook for 1918 are handled directly as commercial sales, by 
the Public School Publishing Co., Bloomington, Illinois, at the rates 
indicated on the cover of this monograph. To obtain the entire 
Yearbook for 1918 as a member of the Society, pin your check or 
postal order to the following slip, properly filled out, and mail to 
the Secretary now. 

APPLICATION FOR MEMBERSHIP 

To Guy M. Whipple 
Secretary of the National Society for the Study of Ed%u>ation 
The University of Illinois, Urbana, Illinois 

active j 
Please enroll me as an v member 

associate ) 

* . , ( $2.00 as payment of active dues for calendar year 1918 
( $1.00 as payment of associate dues for calendar year 1918 

Name 

Address to which 
to mail 
Yearbooks 
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COMMITTEE'S PREFACE 

The National Aasodatioii oi Diiecton of Educational Re- 
search present thia Tearbodc on Educational Measurement to the 
superintendents and teachers of American schools, hoping that it 
may prove of practical value to them in their work. Its purpose is 
to gather into one handy volume a rather complete statement of the 
various aspects of a new movement which seems destined to have 
a profound and permanent influence upon American education. 
Each chapter has been written by a different member of the Associ- 
ation, and as in any new field of work, complete agreement in either 
theory or practice is not to be expected, so in this volume the careful 
reader will detect many evidences of healthy variations in ideals, 
aims and methods. However, it is believed that these differencea 
are not serious enough to mar the unity of plan and content and 
that the bode as a whole represents the best judgment of the Associ- 
ation as to what information is of greatest practical worth. The 
Yearbook is issued in the hope that it may further the cause for 
which the Association stands — ^the promotion of educational re- 
search in American public schools. 

The editorial committee, on behalf of the Association, hereby 
gratefuUy acknowledges its indebtedness to the National Society for 
the Study of Education, whose cooperation has made the publica- 
tion of a yearbook possible. 

EDITORIAL COMMITTEE 

Stuart A. Courtis, Chairman, 
Leonard P. Ayres, 
B. R. Buckingham, 



CHAPTER in 

SPECIFIC USES OF MEASUREMENT IN THE SOLUTION 

OF SCHOOL PROBLEMS 



M. E. Haooxbtt 
Director, Bureau of Cooperatiye Beseareh, Uniyeraitj of Minnesota 



In preparing this chapter on the speci&c uses of measure- 
ment in the solution of school problems the writer mailed to a se- 
lected group of school superintendents, most of whom were known 
to have used tests add scales, a questionnaire. Chiefly it was sought 
to learn what changes in school organization and procedure had been 
made as a result of such measurement 

Among 200 replies received there were 62 which reported some 
conscious alteration in the work of the school following the use of a 
standardized scale or test. In general, these changes may be 
grouped under six heads as follows: 

1. Changes in classification of pupils 

2. Changes in school organization 

3. Changes in course of study 

4. Changes in methods of instruction 

5. Changes in time devoted to subject 

6. Changes in methods of supervision 

Under these same heads it is convenient to group the remedial 
measures described in the periodical literature, and the discussion 
to follow will, therefore, make use of this classification. Under each 
head will be given results of the questionnaire. These results are 
fragmentary, but serve to indicate the range of things which school 
officers wisely or unwisely do as a result of information derived 
from educational measurements. Under each head will also be 
given one or more detailed examples of the type of remedial work in 
question. No attempt is here made to give an exhaustive review of 
the literature. Only suggestive cases are used. 

25 
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EDITOR'S PREFACE 

In prefacing Part I of the Sixteenth Yearbook it was stated 
that the poli<7 of the Society to give preference in its Yearbooks to 
contributions that would disseminate the reports of important com- 
mittees in advance of the meetings at which they are to be discossed 
had been favorably received both by members of the Society and by 
large numbers of the educational public It was also stated as ''not 
unlikely that other committees and organizations of men profes- 
sionally active in various aspects of educational endeavor will be 
glad to make similar use of the Society's avenues of publication in 
the future." This expectation has been realized in a most gratify- 
ing way in the Seventeenth Yearbook. I wish to congratulate mem- 
bers of the Society on this opportunity to serve themselves as well 
as the cause of education by cooperating with the National Associ- 
ation of Directors of Educational Research in the publication of the 
Yearbook these investigators have prepared. 

G. M. Whipplb. 




COiDflTTEE'S PKEFACE 

The National Anodation ot Directors of Edaeational Be- 
aeareh present this Yearbook on Edaeational Measorement to the 
saperintendents and teachers of Ameriean sehods, hoping that it 
may prove of practical vahie to them in their work. Its purpose is 
to gather into one handy Tolnme a rath^ complete statement of the 
▼arions aspects of a new movement which scans destined to have 
a profound and permanent influence upon American edaeation. 
Each chapter has been written by a different member of the Associ- 
ation, and as in any new field of work, complete agreement in either 
theory or practice is not to be expected, so in this volume the careful 
reader will detect many evidences of healthy variations in ideals, 
aims and methods. However, it is believed that these differences 
are not serious enough to mar the unity of plan and content and 
that the book as a whole represents the best judgment of the Associ- 
ation as to what information is of greatest practical worth. The 
Yearbook is issued in the hope that it may further the cause for 
which the Association stands — ^the promotion of educational re- 
search in American public schools. 

The editorial committee, on behalf of the Association, hereby 
gratefully acknowledges its indebtedness to the National Society for 
the Study of Education, whose cooperation has made the publica- 
tion of a yearbook possible. 

EDITORIAL COMMITTEE 

Stuabt a. CouBns, Ckairman, 
Leonard P. Atbes, 
B. R. Buckingham, 
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SPECIFIC USES OP MEASUREMENT IN THE SOLUTION 

OP SCHOOL PROBLEMS 



M. E. Haqokbtt 
Direetor, Bureau of Cooperative Besearchy Uniyenity of Mmnesota 



In preparing this chapter on the specific uses of measure- 
ment in the solution of school problems the writer mailed to a se- 
lected group of school superintendents, most of whom were known 
to have used tests aild scales, a questionnaire. Chiefly it was sought 
to learn what changes in school organization and procedure had been 
made as a result of such measurement. 

Among 200 replies received there were 62 which reported some 
conscious alteration in the work of the school following the use of a 
standardized scale or test. In general, these changes may be 
grouped under six heads as follows: 

1. Changes in classification of pupils 

2. Changes in school organization 

3. Changes in course of study 

4. Changes in methods of instruction 

5. Changes in time devoted to subject 

6. Changes in methods of supervision 

Under these same headef it is convenient to group the remedial 
measures described in the periodical literature, and the discussion 
to follow will, therefore, make use of this classification. Under each 
head will be given results of the questionnaire. These results are 
fragmentary, but serve to indicate the range of things which school 
officers wisely or unwisely do as a result of information derived 
from educational measurements. Under each head will also be 
given one or more detailed examples of the type of remedial work in 
question. No attempt is here made to give an exhaustive review of 
the literature. Only suggestive cases are used. 

25 
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I. Classification of Pupils 

1. Changes Indicated by Replies to Questioimaire 
Changes in classification were of three sorts : 

(a) The promotion and demotion of individual pupils who 
were found improperly classified. * * We gave certain pupils doable 
promotions." **We demoted and promoted pupils who did not fit 
the grade they were in. " * * Bright pupils were put into relief by the 
tests and afterwards examined; a large number were promoted 
thus.'* 

(b) A transfer of pupils from one grade to another for par- 
ticular subjects. * ' Pupils were transferred in reading to grades for 
which the tests revealed they were fitted, " ' * When pupils reached 
Quality 10, Thomdike handwriting scale, in monthly tests they were 
promoted into advanced section, meeting three times a week," '' Pu- 
pils classified in reading according to score in test : (1) those below 
Kansas Standard drilled in thought interpretation; (2) those who 
equalled Kansas median given no extra attention; (3) those who 
tested a grade higher allowed to drop reading for a time and work 
on any study they were low in." 

(c) A general reclassification of entire school. ''I classified 
my school below seventh grade so pupils could make up work where 
they were weak and take advanced work where they were strong." 

2. Detailed Example 
In the University of Minnesota High School 60 pupils were ac- 
cepted at the opening of the school year as beginners in the fresh- 
man class. These students were required to take English and gen- 
eral science and had a choice of two of the following : Latin, an- 
cient history, and mathematics. Before the first day of school they 
were tested, as a group, with the Trabue completion scale, an anal- 
ogies test, and an omnibus mental test. Later they were tested with 
Thomdike 's reading scale Alpha 2, a series of arithmetical prob- 
lems, and a wide range of mental and educational tests. The in- 
itial tests were given in order to get a measure of the probable suc- 
cess of the several students and to find an intelligible basis for sec- 
tioning the group for purposes of instruction. On the basis'^of the 
test scores, the students were divided into two or more classes for 
the several school subjects. 
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The school marks for these stadents were given in all by seven 
instructors ; each stadent was rated by four different teachers. The 
marks were in letters A, B, C, D and F and were based upon a rel- 
ative marking system. In the total marks to be here considered A 
was given to 8.6 percent of the class, B to 21.2 percent, C to 43.3 
percent, 2) to 20 percent and F to 6.8 percent In the work in gen- 
eral science, where two sections were taught by different teachers; 
the instructors conferred in giving the marks, so that the sixty 
pupils were rated as a single group. This rating was in large meas- 
ure on the basis of objective tests which were the same for all. Sim- 
ilar objective tests were used in all subjects. 

The marks to be here considered are those given at the end of 
the first month. These marks, more than those to be given later, 
are liable to inaccuracy as indicators of ability to do the high-school 
work. Now, comparing these marks^ with the scores in the standard 
tests, what do we findf 

The first and simplest measure of prophecy which we wish to 
find is the median attainment, for sixty pupils can be fairly divided 
into two sections for high-school instruction. If, by dividing them 
on the basis of the tests, we get the more capable half in the upper 
section and the less capable half in the lower section, the prophecy 
of the tests is confirmed. Figuring the median attainment, we find 
that the omnibus test placed 72 percent of the sixty pupils in that 
half of the class in which they were placed by the teachers' marks 
for the first month. Likewise, the reading scale Alpha 2 placed 72 
percent correctly. When the scores of the two tests are combined 
the median retention is 76 percent In other words, the tests placed 
more than seven pupils in every ten correctly before they had done 
a single day of high-school work. 

As a matter of fact, the prognosis was even better than this, for 
all of the instructors were agreed that the school marks did not rep- 
resent the abilities of all of the pupils accurately. Thus, one boy 
of acknowledged ability stood 12 in the omnibus test and 22 in the 
reading test. In marks he stood 57, scoring C in history and fail- 
ing in general science, mathematics and English. Every one, in- 



^These data are available tlirongh the cooiteey of Dr. W. S. Miller, Prin- 
cipal of the Uniyersitj of Mumesota High School. 
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duding the boy himself, admits that through this month he idled 
away his time. There is also the opposite type of case — a stadent 
scored low in the tests but by unusual industry lifted himself above 
the median line in marks. When one considers the part which in- 
dustry plays and the variable factors of outside work, social dis- 
tractions, parental interests and personal attitudes in relation to 
school achievement, it is clear that intellectual ability alone is not 
determinative. 

It is encouraging to believe, however, that approximately eight 
children in ten are properly placed by such tests. This idea is 
supported by figuring the average mark of the students in the upper 
and lower halves of the tests. Equliting the letters to the figures 
5, 4, 3, 2 and 1, it is evident that a student carrying four subjects 
could score 20 points. As a matter of fact the upper half as divided 
by reading test scored 13.4 points, while the lower half scored 10.3, 
and similar figures for the two groups as divided by the omnibus 
test are 13.5 and 10.2. If we divide the sixty pupils into three equal 
groups on the basis of the two tests, the upper third averages 14.2 
in marks, with no failures in a total of eighty marks. The lower 
third averages 9.8 with 17 failures in a total of eighty marks and 
only 9 marks above C. 

Seasoning from all these data, it is safe to say that both edu- 
cational and mental tests may be used to classify students for pur- 
poses of instruction ; that a few hours spent in preliminary^ exam- 
ination will foreshadow later achievements to a high degree. Ad- 
mittedly, much technique remains to be developed, but the prom- 
ise is sure. Superior students can be detected and grouped to- 
gether ; mediocre students can be put with mediocre students, and 
weak students, instead of being submerged in the struggle to main- 
tain standing, can receive the help they need. It would be difficult 
to overestimate the increase of efficiency that would come from the 
better adaptation of instruction in consequence of such classifica- 
tion. 

How dependable the tests really are in promoting superior 
students is evidenced by numerous instances, of which the following 
may serve as an example : 
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Robert was 12 years old, beginning second semester of eighth 
grade. His teachers reported him indifferent, doing only ordinary 
work and inclined to be the center of schoolroom disorder and or- 
ganized insurrection. Parents noted that, though previously much 
interested in school, the boy now disliked to attend; he disliked the 
teachers and wanted to drop out. Robert insisted that the studies 
were not interesting, that he knew all he wanted to know about them 
already. Mental examination showed an intelligence quotient of 
142, a mental age probably greater than that of some of his teach- 
ers, who bored him to death by treating him as an ordinary twelve- 
year-old. He was recommended to high school, entered three weeks 
late, led his class at the end of six weeks and at every subsequent 
interval when marks were given. More important, hiB whole atti- 
tude toward school was changed, because the advanced work was a 
real challenge to his mental ability. 

II. School Organization 

1. Changes Indicated by Replies to Questionnaire 
Seven types of change in school organization were indicated 
as follows : 

(a) Change in size of classes. ''Smaller classes in arithme- 
tic." **More teachers in arithmetic." **The services of additional 
teachers demanded for defectives in industrial training." ''En- 
largement of class for defectives." 

(b) Division of classes into special sections. "An advanced 
and a special section made in writing on the basis of errors. ' ' 

(c) Organization of Special Classes. "Opened special room 
for backward pupils." "Organized special corrective work." 

(d) Departmentalization. "Departmentalization of sixth, 
seventh, and eight grades." "Department teaching." 

(e) Arrangement of parallel programs. "Spelling periods 
for different grades arranged for same time to permit transfer of 
brighter pupils." "Same for reading." 

(/) Appointment of supervisors and supervising principal. 
"Position of supervising principal for primary grades created." 
"Appointed a director for a newly organized Bureau of Research." 
"Plan to hire a trained supervisor for writing next year." 

(g) Inauguration of special schools. "An initial attempt 
to develop an elementary industrial school for pupils shown by the 
tests to be unfitted for the regular work." 



Z. Detailed Example 

(€j TmnOa Trogromz. At the Lake Harriet School in 
■eapciia a nwHnrymnit by the A jrei acale ahowed a wide 
tioa of iprfHiig attainmen t aflMng the popfla of cadi daaiL Im 
&A ^Ride, 4&Z penmt of the ddldrcn wtre of 
abilitj. Grouped akmi^ with them were 26.7 pcreent of 
grade abOitj, 26.7 percent of sixth-grade abilitj and 3^ p ciicjit of 
fonrth-frade ability. More rariable than thia waa the fifth fciailf 
daoi^ where the diatriboticm ahowed ererj lerd of ahilitj froaa the 
aeeond to the eig^ith grade. On the faaaia of this 
Probat, the principal, obocrred that it waa practieallj 
group inatroction "to deriae a apdling leaMvi whidi would tax the 
eapaeitj of each indiridnal in the gnmp." It waa detcnninied, 
therefore, to rearrange the grouping in sadi manner aa to give creiy 
diild "eapaeitj work." To justify this regrading, farther teste 
giTcn. With the resolts of all the tests as a bams, the pnpila 
redistributed so that thoae of like ability recited together. In the 
new organization the original 7B class retained four pupils from 
an original total of thirty-two. The others were distributed to new 
groups as fcXlawn: seven to 8A, six to 8B, thirteen to 7A and four 
to the sixth grade. To the new 8B group, the several grades contrib- 
uted in this fashion: 8A gave 7 pupils; 8B gave 14; 7A gave 4; 7B 
gave 6; the sixth grade gave 6; the fifth grade gave 5, and the 
f cmrth grade one — a total of 42. 

When the redistribution of the pupils on the baab ct ability 
had been made, the spelling recitations for all were arranged to take 
place between 11 :45 and 12 KK) o'clock on each day. At the sound 
of the bell, each pupil passed to the room where his particular level 
of work was in progress. There he would go each day until a defin- 
ite change in his work occurred. If the average of his work for two 
consecutive weeks diould fall below 90 percent, he autcmiaticany 
gravitated to the grade below. If he maintained a standard of 99 
percent for four successive weeks, he was promoted to the grade 
above. To illustrate : two 8B boys whose beginning record showed 
about 65 percent dropped back to the fifth grade. Unable to main- 
tain the pace of this grade, they dropped back to the fourth. 
''Here,'' to quote Miss Probst, "they evidently found their spell- 
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ing level, for they tx)ok a fresh start, were promoted to the fifth 
grade, then to the sixth and finally to the 7B group." 

The chief outstanding result of the experiment was a very great 
diminution of the variability in the several grades. Whereas in 
the first test but 43.3 percent of the 8A pupils had eighth-grade 
spelling ability or better, 71.4 percent came up to this standard in 
the second test in May. In the 7A dass, the corresponding figures 

_ _ ■ 

were 45 and 80 : in the sixth grade they were 55 and 90. 

(b) Special Classes in Schools. A second change in school 
organization brought about by means of educational and mental 
tests is the institution of special classes for the education of excep- 
tional children. Wallin reports (1914) eleven types of such classes. 

(c) Organization of Bureaus of Research. Probably the most 
significant change in school organization growing out of the meas- 
urement movement is the organization of Bureaus of Research as 
a supplementary supervisory and administrative ag6n<^. Since 
this topic is treated at length in other chapters of this report an ex- 
tended statement is unnecessary at this place. 

III. Course op Study 

1. Changes Indicated by Replies to Questionnaire 
It was difficult often to differentiate changes in the course of 
study from changes in methods of instruction. Under this head 
four types of change were more frequently noted than any others. 

(a) Change of Textbooks. In some cases the textbook was 
merely changed for another book. In other cases, the book was ap- 
parently dropped altogether and other types of material substi- 
tuted. 

(b) Emphasis was changed by giving more space in the 
course to different parts of a subject. This seemed to be especially 
true in arithmetic and in spelling. 

(c) Numerous replies indicated that the tests served to fix 
standards of achievement for different grades. 

(d) The organization of specialized curricula for special 
classes. 
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2. Detailed Examples 

(a) Specific Aims to be Achieved. The effect of educational 
measurements on the course of study has been to fix specific aims 
in the several school subjects. I With most of the standard scales 
and tests there have been proposed ideal forms for the several 
grades, or the average and median scores made by these grades have 
been set as desirable ends to be achieved, y 

The specific aims to be accomplished may be grouped under 
three heads: aims in rate of work^^aims in quality of work; and a 
combination of the two, under the head of efficiency. 

The accompanying table contains a representative set of such 
aims. The full meaning of these standard scores will be under- 
stood only in connection with the tests themselves. 



SAMPLES OF SPECIFIC AIMB 



ACTIVITT 


HSASUBXD BY 


SCOBB 


Bate of Silent Beading 


Gray (Andent Ships) 


2.87 words per second 


Quality of Silent Beading Thorndike Scale for 

Understanding of Sen- 
tences 


7.50 on Scale Alpha 2 


1 


V^ord Knowledge 


8.50 approximately on 
Scale A, A2 or B 


Addition 


Coartis Series B 


Bate 12 Accuracy 100 
percent 


Addition 


Woody Series A 


Accuracy 9.01 scale 
points 


Beasoning 


Stone 


Bate 8.75 Accuracy 90 
percent 


Spelling 


Ayres scale 


100 to 50 percent on Col- 
umns N to Z 


Writing 


Ayres 


Bate, 79 letters per sec- 
ond 

Quality, 62 Gettysburg 
scale 


Language 


Trabue 


14 to 16 scale points 


Composition 


Harvard-Newton 


70 on scale 


Grammar 


Buckingham 


5.13 questions answered 


Geography 


Hahn-Lack^ 


to 99 percent on 20 sets 
of questions 
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Any pupil who at the middle of his eighth school year can 
achieve the above standards should be considered normal for the 
grade. A lower attainment clearly indicates the need of remedial , 
work for the class or individual in question. A distinctly superior 
achievement is evidence of superior intelligence on the part of the 
pupils or of superior methods of instruction. 

(b) Minimal Essentials. A second important movement mak- 
ing use of measuring methods is the effort to derive minimal essen- 
tials. Of the nine methods of determining the minimal content of 
the course of study described by Coffman, at least four are essen- 
tially methods of measuring the acquired behavior of children and 
adults ; two are measurements of the content of reading matter, and 
the other three are concerned with pooled opinions. Of the ten 
chapters in the Sixteenth Yearbook of this Society, ** Minimal Es- 
sentials in Elementary School Subjects," five make direct use of 
information derived from the measurement of children's attain- 
ments. The other five are based on measurements of the content 
of books and other published material. 

It is unnecessary to enter here into a detailed statement of these 
investigations. It is sufKcient to note that the determination of the 
content of the course of study must follow two fundamental prin- 
ciples suggested by the following questions: (1) What should 
children know and do as children and adults f (2) What can 
children at any age learn with profit f The final answer to both of 
these questions must be obtained by measurement 

IV. Methods op Instruction 

1. Betums from Questionnaire 

(a) Increased Emphasis. Approximately one-third of the 

replies note ''increased emphasis," which apparently means more 

time given to a subject or more value placed ui>on efficiency in it. 

The following are representative of these replies : 

''More emphasis, all grades, on meanings of words and sen- 
tences.'* "Stressing legibility in writing.'* "Greater emphasis 
on fundamentals in arithmetic." "More emphasis on correct use 
of words in reading, less on definition." "Special emphasis given 
to those subjects where standard was low." "More drill in all 
grades." "More silent reading." 
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(6) Drill. The favorite recourse for improving attainments 

which the tests show to be poor is "drill." This term is vague^ 

pften meaning merely more time devoted to repetition of certain 

processes. 

' * Arithmetic : All teachers required to give more drill work. ' ' 
' ' Special emphasis given to those subjects where standard was low. ' ' 
''Pive-minute daily drill on fundamentals in arithmetic." **More 
time and attention given to drill in number combinations." ''Dic- 
tation drills with attention on punctuation. " *' More intensive drill 
in grammar and punctuation. " ' ' More drill in spelling. ' ' 

(c) Specialized DriU. Some correspondents report a partic- 
ular type of drill, involving a definite change in the details of the 
drill process as well as change of time 

"Courtis drill cards in arithmetic in two rooms; more oral 
drill in all." "Horace Mann method of spelling adopted." "In- 
stalled Palmer method of writing." 

(d) New Devices. Another method of improvement of in- 
struction was the invention of special devices. 

"Made room charts showing individual's work (median, quar- 
tile, safety zone) . " " Teachers used questions similar to Kelley test, 
and applied to geography and other subjects." "More instruction 
through interest of pupil." "Supervised study periods — all 
grades. " " Three periods of supervised study added to school day : 
tiiiose who failed in one subject required to stay 1 period ; in two, 2 ; 
etc. " " Greater use of dictionary for meaning of words. " " Tests 
devised to watch pupils ' progress. ' ' 

(e) Individualized Teaching. The measurements serve to fix 

attention on individual differences among children and to further 

the adaptation of instruction to individual needs. Illustrations: 

"Individual attention; specifics devised for securing appreci- 
ation of good writing." "Individual help given slow pupils." 
"Methods adapted to ability of pupils." "Backward pupils dis- 
covered and given special attention." "Promotion more by sub- 
jects." 

2. Detailed Examples 

(a) Methods of Drill in Arithmetic. Mead, at the request of 
Superintendent Condon of the Cincinnati schools, undertook the 
experimental evaluation of two kinds of practice material in the 
fundamentals of arithmetic. The materials in question were the 
Courtis Standard Practice Tests and the Thompson Minimum Es- 
sentials in the four fundamentals. About 900 fifth-grade pupils 
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from fourteen schools were divided into two approximately equal 
groups and were drilled 15 minutes daily from February to May. 
The efficacy of the two kinds of practice material was determined by 
''preliminary and final standard tests with each group'' (Courtis 
Series B). The initial and final tests, as well as the intervening prac- 
tical exercises were given by the class teachers under standardized 
instructions, and care was taken to keep conditions constant and fa- 
vorable. 

The results of this carefully controlled experiment show that 
in speed of work the two kinds of practice material produce im- 
provement, and essentially the same amount of improvement. Both 
also show gains in accuracy of work, but they differ essentially in 
the amount of improvement in accuracy resulting from the exer- 
cises. The pupils of the twelve classes using the Thompson Mini- 
mum Essentials show median gains in percent of accuracy for the 
four fundamentals of 2.5, 4.0, 2.9, and 15.7 ; similar figures for the 
Oourtis Practice Tests were 9.7, 8.1, 8.9, and 18.2. Clearly, the 
Courtis Practice Tests are superior, and the test shows in what re- 
spect they are superior. 

It does not follow from this that the Thompson Minimum Es- 
sentials are of no value or that in another grade and under other 
conditions they might not prove superior. What is fairly certain 
is that, upon the use of the two methods in fifth-grade classes under 
school conditions prevailing in Cincinnati schools from February to 
May, 1916, and described by Mead, the debate has dosed. 

(6) Teaching of Handwriting. The "two-squad" method 
has been used by Mr. A. Q. Capps in measuring the effect of ''diag- 
nosis and corrective measures in the teaching of handwriting." 
The handwriting of 44 sixth-grade children was measured on Octo- 
ber 9. All who scored high on the Thomdike scale, Quality 9 or 
more, and whose papers were relatively free from common errors, 
were put into an "advanced dass." All others were put into a 
"special class." The advanced class was taught three days per 
week ; the special class, five days per week. A pupil was allowed to 
pass from the "special" to the "advanced" dass, when on the 
monthly tests he scored Quality 10 (Thomdike). 
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All pupils were treated by the same gi^ieral method, which was 
as fidlows: The handwritiiig of each pnpil was diagnosed follow- 
ing Freeman's analysis of "quality" into alignment, spacing, 
dant, quality of line, and letter form. On the basis of this diag- 
nosis, remedial treatment was prescribed for each dass and for each 
individual, and detailed methods of instruction were worked oat. 
The pupils were made acquainted with their own difficulties and 
taught to practice with a view to achieving certain detailed aims, 
sudi as better form for the letter a, improved alignment, etc The 
experiment was continued for five months, and standard tests were 
given at four- week intervals. 

The significant results of the experiment may be stated as fol- 
lows: (1) The advanced dass improved in quality from 9.06, or 
less than fifth-grade attainment, to 10.47, or slightly more than 
seventh-grade scores (60 minutes per week) . (2) The special dass 
improved from 8.74, or fourth-grade score, to 9.68, or dightly less 
than sixth-grade average (100 minutes per week). In both classes 
there was a substantial gain in speed. 

In the light of these results, regarded as tentative by the ex- 
perimenter, there can be little doubt this teaching method has con- 
siderable claim to effidem^. 

(c) Improvement in Written Composition. Somewhat differ- 
ent in type is the study by Brown and Haggerty of the improve- 
ments in En^ish ciHuposition. The weekly composition exercises of 
three high-schod classes through a period of twelve weeks were 
measured by the Harvard-Newton Scale. By this method it was pos- 
sible to secure a '^learning curve" for individuals as well as classes, 
and thus to see the educational behavior of a student somewhat 
more intimately than when only initial and final measurements are 
made. 

From this exi>eriment several facts stand out. (1) There is 
no essential difference in composition performance among dasses 
rated as first-semester freshmen, second-semester freshmen, and 
first-semester sophomores. (2) In g^ieral, classes gain in i>ower 
to write during a twdve^weeks period about four or five Harvard- 
Newton Scale points. (3) Some students, relativdy poor ones, 
gain much more than the dass average, in some cases as much as 



U8B8 OF MEA8UBEMBNT IN SCHOOL PB0BLEM8 87 

twenty scale points. (4) Other stadents, often the superior indi- 
viduals, make little or no improvement; some individuals do more 
poorly at the end of the twelve-weeks period that at the beginning. 
(5) Some composition topics elicit better products than others, as 
shown by the median scores of all classes. 

This simple experiment does not get very far in solving the man- 
ifold perplexing problems of composition teaching. The method, 
however, offers a means of further investigation. 

V. Time Distribution 

The changes in time were mostly of the nature of increased 
time to subjects where the tests showed the product to be low grade. 
The following are characteristic replies: 

''Lengthened periods for subjects where deficiency was great- 
est." "More time given to arithmetic.'* "More time given to writ- 
ing in all grades. " " Ten minutes of arithmetic recitation period 
used for drill three days per week." "Increased number of hours 
for industrial work." 

Only one correspondent reported a diminution of time, say- 
ing, "We excused pupUs and grades from work 'over done'." 
Numerous studies, from that of Dr. Rice on, have shown that results 
of school work are not directly correlated with the time spent on the 
subject. Studies in handwriting, spelling and arithmetic show that 
the maximal time may yield poorer returns than a smaller amount 
of time.* 

VI. Changes in Supervision 

As a rule, tests have been introduced into the schools through 
the supervisory and administrative officers. It is not surprising, 
therefore, to find that the results of the tests have had a direct and 
considerable effect on the detailed work of such persons. 

The general supervisory practice is to rei>ort the results of tests 
to principals and teachers. Such a report gives not only the scores 
of the class or classes concerned but also comparable norms from 
other classes within the system and from other systems. Appar- 
ently some supervisors end their use of the tests with this report 



'Some concrete studies in this field were reviewed by the writer in School 
and Society, November 19, 1916. 
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A second step taken by other supervisors is a conference be- 
tween the teacher and supervisor, a conference in which ''the opin- 
ion of the supervisor is not pitted against that of the teacher, but 
in which the attention of both is directed to the definite and object- 
ive result of the test and to the causes producing such result.'' 
Growing out of such conferences come ''new outlines of work," 
"re-organization of programs/' "special lessons for teachers in 
teaching spelling," "requirements in the handwriting of teachers," 
in fact, any one of the changes hitherto enumerated. 

A third step to be noted is a further examination of a class or 
pupil for the extension of the diagnosis. This is made with other 
tests and through personal investigation. 

A fourth step taken by some supervisors and teachers is a 
second measurement, after a period of remedial work, to test the 
efficacy of the changed program. In about one-fifth of the cases 
where remedial work was reported, the supervisor had used the 
tests in this way. The following are typical replies : 

In arithmetic "Graph showed greater improvement in grade in 
one month, than first graph showed from class to class (five months' 
work)." "Have used drill and are now above the Courtis Stand- 
ard." "The weaker pupils do better work. More pupils brought 
up to required standard. Pupils more accurate." "Plateau dis- 
appeared which had existed from Grade VI to VIII ; curve for both 
attempts and rights in all operations shows gradual development 
to Grade VIII." 

In reading : ' ' Improvement in median score from September 7 
to January 23 ; Grade VII, 5.3, Grade VIII, 5.6." 

In spelling: "Pupils average a grade higher." "More un- 
iformity of grades and children know where they stand." 

In writing: "Better quality. Both quality and speed nearer 
average for grade." 

A fifth important use of tests by supervisors is to keep track 
of the normal progress of students and classes. Results of such tests 
serve as a sort of weather map of the school system and show the pre- 
vailing winds. They enable the supervisor to know in an intimate 
way the entire system and to direct his efforts at supervision where 
they are most needed. Where fair progress is being made he can 
give little attention and save his usually inadequate energy for the 
places where it is most needed. 
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Finally, it is apparent that supervisors are making the class 

attainment, as shown by the results of measurement, one factor in 

the rating of teachers and for the further professional training of 

teachers. The following replies show this : 

* * Introduced a system of teacher training. " ' ' Certain teachers 
required to go to summer-school.'' "Teachers required to visit 
classes with strong teachers." ''In second semester, changed 
teacher whose class was weak to a lower grade class, to test power 
and presentation of subject. " ''Certain changes in both principals 
and teachers, and will require certain teachers to attend summer- 
school." 

The experience of one supervisor is related in a most interests 
ing paper on the Supervisor's Use of Standard Tests, by J. C. Morri- 
son, who presents the details of a year's work in Chatham, Mass., 
and sums up the work in these words : 

"Standard tests have proved an effective means in super- 
vision. Through their use teachers are improving the technique of 
their method and exercising a nicer judgment in the relation of sub- 
ject matter. Pupils are working to exceed their own record. Teach- 
ers and older pupils are coming to understand the scientific idea of 
education as it applies to the ordinary classroom. In no other way 
could the principal gain so close a knowledge of each individutd 
child in the school. This knowledge is serviceable in placing new 
pupils, in determining promotions, in selecting accelerates and de- 
fectives, in searching out the special difiSculties of the individual, 
and in gaining the cooperation of the parent The results of the 
tests have proved of interest to the public. On the basis of these 
results the board of education has employed a teacher to give ap- 
proximately one third of her time to the testing and supervision of 
work with special pupils. The school has made a start in the study 
of its children and will eliminate a large part of the wasted time 
and effort that results from the choice of the wrong high-school 
course." 

In this survey of remedial measures based on the use of stan- 
dard tests one observes that many of the changes made are the time- 
honored ones which school officers have traditionally made on the 
basis of personal opinion and in response to changing ideas. Ai>- 
parently what the tests do in such cases, is to render definite the 
arguments for these changes and to make accurate the evaluation 
of the efficiency of remedial measures when once they have been car- 
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A second step taken by other supervisors is a conference be- 
tween the teacher and supervisory a conference in which ''the opin- 
ion of the supervisor is not pitted against that of the teacher, bat 
in which the attention of both is directed to the definite and object- 
ive result of the test and to the causes producing such result." 
Growing out of such conferences come ''new outlines of work," 
"re-organization of programs," "special lessons for teachers in 
teaching spelling, " " requirements in the handwriting of teachers, ' ' 
in fact, any one of the changes hitherto enumerated. 

A third step to be noted is a further examination of a class or 
pupil for the extension of the diagnosis. This is made with other 
tests and through personal investigation. 

A fourth step taken by some supervisors and teachers is a 
second measurement, after a period of remedial work, to test the 
efficacy of the changed program. In about one-fifth of the cases 
where remedial work was reported, the supervisor had used the 
tests in this way. The following are typical replies : 

In arithmetic "Graph showed greater improvement in grade in 
one month, than first graph showed from class to class (five months' 
work)." "Have used drill and are now above the Courtis Stand- 
ard. " " The weaker pupils do better work. More pupils brought 
up to required standard. Pupils more accurate." "Plateau dis- 
appeared which had existed from Grade VI to VIII ; curve for both 
attempts and rights in all operations shows gradual development 
to Grade Vni." 

In reading : "Im prov ement in median score from September 7 
to January 23 ; Grade VH, 5.3, Grade VIH, 5.6." 

In spelling: "Pupils average a grade higher." "More un- 
iformity of grades and children know where they stand." 

In writing: "Better quality. Both quality and speed nearer 
average for grade." 

A fifth important use of tests by supervisors is to keep track 
of the normal progress of students and classes. Results of such tests 
serve as a sort of weather map of the school system and show the pre- 
vailing winds. Th^ enable the supervisor to know in an intimate 
way the entire system and to direct his efforts at supervision where 
they are most needed. Where fair progress is being made he can 
give little attention and save his usually inadequate energy for the 
places where it is most needed. 
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Finally, it is apparent that supervisors are making the class 

attainment, as shown hy the results of measurement, one factor in 

the rating of teachers and for the further professional training of 

teachers. The following replies show this : 

* * Introduced a system of teacher training. ' ' ' ' Certain teachers 
required to go to summer-school.'' "Teachers required to visit 
classes with strong teachers." "In second semester, changed 
teacher whose class was weak to a lower grade class, to test power 
and presentation of subject" "Certain changes in both principals 
and teachers, and will require certain teachers to attend summer- 
school." 

The experience of one supervisor is related in a most interest- 
ing paper on the Supervisor's Use of Standard Tests, by J. C. Morri- 
son, who presents the details of a year's work in Chatham, Mass., 
and sums up the work in these words : 

"Standard tests have proved an effective means in super- 
vision. Through their use teachers are improving the technique of 
their method and exercising a nicer judgment in the relation of sub- 
ject matter. Pupils are working to exceed their own record. Teach- 
ers and older pupils are coming to understand the scientific idea of 
education as it applies to the ordinary classroom. In no other way 
could the principal gain so close a knowledge of each individutd 
child in the school. This knowledge is serviceable in placing new 
pupils, in determining promotions, in selecting accelerates and de- 
fectives, in searching out the special difiSculties of the individual, 
and in gaining the cooperation of the parent. The results of the 
tests have proved of interest to the public. On the basis of these 
results the board of education has employed a teacher to give ap- 
proximately one third of her time to the testing and supervision of 
work with special pupils. The school has made a start in the study 
of its children and will eliminate a large part of the wasted time 
and effort that results from the choice of the wrong high-school 
course." 

In this survey of remedial measures based on the use of stan- 
dard tests one observes that many of the changes made are the time- 
honored ones which school officers have traditionally made on the 
basis of personal opinion and in response to changing ideas. Ap- 
parently what the tests do in such cases, is to render definite the 
arguments for these changes and to make accurate the evaluation 
of the efficiency of remedial measures when once they have been car- 
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CHAPTER IV 

GENERAL ORGANIZATION OF EDUCATIONAL MEASURE- 
MENT WORK IN CITY SCHOOL SYSTEMS 



Tblaxk W. Ballou 
I>irectory Department Edueational Inveetigatioii and Measurement, 

Boston, Massaehusetts 



Every change which takes place in educational practice is pre- 
ceded by a period of agitation. The profession mnst be made aware 
that a given condition is unsatisfactory and must be convinced that 
the proposed change will bring about improvement. In addition, 
the lay public must be educated to understand the meaning and 
significance of the proposed change. Many educational schemes 
never proceed beyond this stage of professional and public agita- 
tion. 

Following the period of agitation comes a period of trial and 
experimentation, in which the proposed change is subjected to dose 
scrutiny. Generally, both the profession and the public produce 
searching and frequently unjust critics. These criticisms usually 
prevent even a trial of any changes in our educational practice 
which do not give promise of a reasonable degree of success. 

In those cities where special research departments have been 
organized, educational measurement is established beyond the stage 
of argument or debate. There the movement has passed success- 
fully through the periods of agitation and of experimentation. Even 
through the country generally, the movement has received such gen- 
eral recognition and endorsement during the past few years that 
progressive school systems do not now need to be provided with 
arguments in favor of educational measurement. This chapter, 
therefore, is not an argument for the introduction of educational 
measurement: it is not a discussion of the debatable phases of the 
subject ; neither iet it a delineation of the educational advantages to 
be secured by measurement. Rather, it is a description of wajB 
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and means of introducing systematic educational measurement in 
a city school system and carrying it on successfully. The methods 
suggested are those which appear to have succeeded best in those 
city school systems that have undertaken to measure educational 
results in an organized way. 

The time for the introduction of educational measurement into 
a school system should be wisely chosen; standard tests should be 
given only after the way for them has been carefully prepared. The 
success of any educational reform depends on the intelligent co- 
operation of the members of the educational profession. This is 
especially true of educational measurement, because it involves an 
entirely new method of attacking educational problems and an al- 
tered attitude on the part of teachers toward the whole educative 
process. Success is contingent on a thorough understanding of the 
aims, methods, possibilities, limitations, and achieved results of 
the use of standard tests and scales. Unless and until the profes- 
sion is so informed, and as a result is prepared to cooperate effect- 
ively in its administration, the possible values of educational meas- 
urement are not likely to be secured. Proper instruction through 
lectures, talks, and teachers' meetings will do much toward pre- 
paring the way for success in carrying on such work. 

Educational measurement involves selection of the tests to be 
used, testing the children, marking or scoring the papers, tabulat- 
ing and interpreting the results, and utilizing the conclusions as 
a basis for securing improvements in teaching when the outcome 
proves that the present teaching is unsatisfactory. This chapter 
deals with each of these topics. 

A. Selecting the Tests 

The attitude of teachers and others towards educational meas- 
urement depends largely on first impressions. The importance of 
making favorable first impressions, therefore, cannot be over-em- 
phasized. The first standard test selected to be given In a school 
system should be one which is most likely to be favorably received 
by teachers. Fairly satisfactory tests for several subjects or phases 
of subjects are now to be had.* 



^See Copter VII for a list of available standard tests and scales. 
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Adequate standard tests for any school system should possess 
the following characteristics: they should measure educational pro- 
ducts obviously within the scope of the course of study of the city ; 
they should aim to measure those subjects or phases of subjects 
which are clearly measurable; they should be reasonably simple; 
they should be accompanied by adequate instructions as to how they 
are to be given and how the results are to be scored ; they should be 
scored and tabulated with reasonable ease ; they should already have 
been given to a sufficient number of children so that well-founded 
standards of achievement have been established. 

The demand for standard tests in various subjects has been so 
great that some questionable tests have been put on the market. 
For example: a so-called 'standard test in spelling' is available 
which tests the ability of children in Grades V to VIII to spell such 
words afi; the following: nunciature, sphericity, Tioggery, senescent, 
symmetrize, incremental, rigmarole, verisimilitude, anthropometric, 
tubule, erosible, and divestiture. These words are not to be found in 
the course of study in most school systems in the United States. 
Lack of ability to spell such words cannot be charged against the 
schools, because the schools have not undertaken to teach children 
to spell thenL This test and others like it that do not measure 
classroom instruction, should b^ avoided — at least in the beginning 
of testing work. If they are used, the purpose in giving them and 
their limitations should be distinctly understood. There are satis- 
factory standard tests in spelling which are obviously within the 
scope of classroom instruction. 

Criticism has been urged against educational measurement on 
the general ground that important products of good teaching in cer- 
tain phases of all subjects and in all phases of certain subjects can- 
not be quantitatively measured. Whether this is so or not may be 
debatable: let the debate go on. It is not necessary, however, to 
postpone all educational measurement until the debate is settled. 
In the meantime, giving standard tests in measurable subjects or in 
measurable phases of subjects will be profitable for teachers and 
pupils, and may also furnish valuable information by which to 
determine to what extent the results of educational practice gen- 
erally are measurable. 
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In introdncing educational measurement into a school i^t^n 
for the first time, the more simple the tests are, the better. To be usa- 
ble, standard tests must be accompanied by adequate instructions 
for giving them and for marking the papers. Unfortunately there is 
no royal road to travel in carrying on educational measurement. 
The details of giving the tests must be mastered by those who would 
make proper use of them. If tests are worth giving at all, they 
should be given according to the systematic plan which the author 
of the tests has worked out. Success in introducing testing into a 
school system will be more certain if the tests are selected only after 
careful consideration of the instructions for giving and scoring 
them. 

It is also important that well-recognized tests be used in the 
initial testing in a school system. Not everyone who desires to give 
standard tests has the time, resources, or qualifications for prepar- 
ing his own tests. It cannot be too urgently recommended that at 
first tests should be selected from those already available. Later, 
one may successfully experiment with the preparation of the tests. 
Among the gravest dangers which educational measurement faces 
today is that which arises from amateurish attempts at the con- 
struction of standard tests by those who do not realize the need for 
a careful testing of the tests themselves before they are published 
for general use. 

Well-recognized tests are urged for use; first, because such 
tests are undoubtedly superior to those which would be prepared 
under most circumstances by a beginner ; second, and more partic- 
ularly, because the results achieved in any school system can thereby 
be compared with similar results from other school systems. 

One of the desirable outcomes of the giving of standard tests 
is the establishment of standards of achievement. Such standards 
furnish measures with which one may compare his own results. 
Standards are adequate, however, only when they are based on a 
large number of results. Tests which have been standardized from 
the results achieved by a small group of pupils in one or two school 
systems are to be avoided unless there are other quite special reasons 
for using them. 
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Testing should always be purposefol. Testing children merely 
for the sake of giving tests cannot be too thoroughly cond^nned. 
The following principle of practice is commended: never give a 
standard test unless you have a definite purpose related to the im- 
provement of instruction and unless you are prepared to tabulate, 
interpret, and use the results at once. 

Since the ultimate purpose of all educational measurement is 
the improvement of the instruction, it also becomes of paramount 
importance that the results be made known to the teachers and 
others before their interest in the tests has waned. 

B. Getting Tests Given 

Let us repeat that if the results obtained from giving standard 
tests are to be worth the time, money, and effort expended, the tests 
must be properly given. This means not only that they must be given 
in the same manner in every classroom throughout a school system, 
but it means, also, that they must be given according to the direc- 
tions that accompany the tests. If this is not done, the results 
cannot be compared with the standardized achievements in other 
cities — a fact which renders the interpretation of the results very 
difficult, if not impossible. 

It may be assumed that the author of the tests had reasons 
for adopting the procedure indicated by his instructions, and that 
the most effective use cannot be made of the results obtained in any 
school system unless those directions are followed. Even though 
one does not agree with the directions for conducting the tests, 
one would better not use the tests at all than to deviate in any im- 
portant respect from the author's directions for giving them. 

Tests may be given either by principals, supervisors, or teach- 
ers, or by persons especially trained for the purpose. Such tests 
as spelling tests, which are among the simplest, to give, may be 
given satisfactorily by principals or teachers. They do not require 
careful timing, and the directions for giving are comparatively sim- 
ple and are easily followed. With a minimum of instruction any 
principal or teacher can successfully conduct spelling tests. 

Such tests as the Courtis standard tests in arithmetic offer a 
more difficult problem. They must be accurately timed and the 
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conditions under which th^ are given must be controlled. Thoee 
who give mich tests must be specifically trained for the purpose. 

For this purpose one of two methods may be followed: a group 
of teachers or principals in the service may be instructed, outside 
of school hours, and assigned to give these tests in the various 
daaMS throughout a city. Or, as in Boston and other cities, those 
preparing to beccmie teachers may be trained to give these tests 
as a part of their preparation for teaching. In Boston each mem- 
ber of the senior class in the Normal School spends one month in 
the Department of Educational Investigation and Measurement and 
receives instruction in the meaning of educational measurement 
and the training necessary for giving such tests as the department 
desires to have given. Following this training, these seniors are as- 
signed to give the tests in the various schools of the city.' Very 
similar arrangements are made in many other places. Cities in 
which a college or university is located have also used trained c(d- 
lege students of education as special examiners. 

Experience has not yet determined which practice is likely to 
be followed in the future. It is certain that whoever gives tests 
must receive proper instruction in the methods of giving them. The 
policy of training normal-school seniors in measurement work is 
based on the assumption that the teaching staff of a city ought to 
be competent to give such tests as are needed for the measurement 
of the work of a school system. If the teachers of a city can be so 
trained, this is undoubtedly the cheapest and most effective method 
of solving the problem. If, for one reason or another, teachers do 
not prove satisfactory as examiners, then it necessarily follows that 
competent specialists must be employed for giving the tests, as well 
as for carrying on other phases of educational measurement. What- 
ever be the method finally adopted, those who give tests must not 
only be properly instructed, but their work must also be adequately 
supervised. This supervision is the function of a department of 
educational research. In the absence of such a department in a 
school system, the superintendent's office should assume this re- 
sponsibility. 

One of the difficulties in relying on the teaching staff as a 
whole to give standard tests grows out of the attitude of teachers 

*See article by tbe writer in School and Society, Vol. V. pp. 61-70. 
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toward sach tests. In their attitude toward edncatioiial measure- 
ment one may expect to find three distinct classes of teachers in 
every school system: (1) those who endorse it, (2) those who are 
indifferent to it, (3) those who oppose it. On this account it is prob- 
ably wise to introduce standard tests into a school system on a vol- 
untary basis ; that is, to give the tests only in those schools or classes 
where principals and teachers are willing to have them given. 

The success of educational measurement in a school system 
depends on doing a small amount of testing and doing it weU, rather 
than on doing a large amount. Quality rather than quantity is more 
likely to win favor. Opposition to educational measurement can 
best be disarmed by showing the improvement secured from the re- 
sults of standard tests. 

C. Scoring the Papers 

The amount of time involved in giving tests is small compared 
with the time necessary for correcting the papers. Assuming that 
the teachers give the tests, who shall mark themt The answer to 
this question depends largely on the character of the tests. Cer- 
tain types of papers from some tests can be satisfactorily marked 
by the pupils under the supervision of the teacher. For example : 
if a spelling test is given by the teacher, she may at once spell the 
words aloud and have the children mark the errors, following the 
common practice. - The pupils' scoring in every case, however, 
should be properly checked by the teacher. Likewise, in some tests 
in arithmetic, children may be provided with answer cards and 
shown how to correct the papers. 

The scoring of many tests, however, involves the exercise of 
some judgment, and pupils cannot be depended on to score such 
tests. In most cases, papers in geography and history should not be 
scored by pupils. Further, if one desires to give credit for a correct 
method in problem work in arithmetic, even though the answer is 
incorrect, the judgment of the teacher is undoubtedly necessary. 

Teachers should not be burdened with an unreasonable amount 
of work in the giving of standard tests. A satisfactory prin- 
ciple to follow may be stated as follows : teachers should be expected 
to correct test papers and tabulate results only in so far as this work 



4B THE SBVBNTBBNTH TBAMBOOK 

will increaae the teacher's knowledge of the abilities of pupib in her 
dasB. Patting this principle into practice would mean that in moat 
cases the teacher may be expected to mark the indiyidnal i>ap6rB 
of pnpils in her class. She may be expected, also, to make class 
tabulations or sommaries of individual achievements, because only 
by so dcnng can the teacher learn where her class stands in relation 
to other dasses in the school, or in relation to the general standard 
of achievement established for the test Beyond dasB sommaries 
the work is likely to be too largely clerical to be of direct value to 
the teacher, and should be carried on by others. 

In marking papers and making dasB tabulations, teachers 
should have some one to whom to look for instruction and guidance. 
If there is no regularly organized department to supervise and 'di- 
rect educational measurement, some qualified person in the system 
should be assigned to do it. Through teachers' meetings held after 
school, for which classes may be dismissed a half hour or an hour 
early and through instructions issued from time to time, the 
supervisor of educational measurement can materially light^i the 
burden which otherwise falls on teachers in this t3rx>e of work. 

D. Tabulation and Interpreting the Results 

In Boston the Department of Educational Measurement has 
found an effective and economical way of making grade summaries, 
school summaries, and city-wide summaries of testing results. Oirls 
from the Boston Clerical School are assigned to this work. These 
girls are being trained specifically for clerical work and on graduar 
tion from school may take positions which require skill in just the 
kind of work involved in making tabulations from tests. The Depart- 
ment asks the Clerical School to send relays of eight or ten girls as 
long as the work lasts. Each group of girls reports for three or four 
days to the office of the Department where the tabulating is to be 
done. The Department instructs them in the special methods of tab- 
ulation, and has the work so fifystematized that a definite record is 
kept of the speed, accuracy and effectiveness of the work of each 
girl. Their attendance is also kept and reports are made to the head 
master of the school when the girls return. The teachers in the Cler- 
ical School consider this work an important part of the practice and 
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training wMch the school desires to give. The Department has found 
it a satisfactory method of getting the work done. The expense to the 
city involves only the car-fare of the students to and from their 
homes to the office of the Department. Much the same method has 
been followed in other cities that have commercial departments in 
their high schools. It affords a practical solution of what is often 
a critical problem in measurement work. 

If teachers or prospective teachers are trained to give the tests, 
and to score the papers of their respective classes, and if commercial- 
high-school pupils or normal-school pupils are used to make grade 
summaries, school summaries, and city-wide summaries, little or 
no direct expense is involved in that part of the work. But even 
though members of the teaching staff or pupils in the school system 
are thus employed, many additional tabulations will be desirable 
and necessary if the results are to serve their greatest usefulness. 
For such work it is essential that competent clerical help be pro- 
vided. It is the kind of work which is not easily done by those un- 
familiar with it, and is likely to be tedious as well as voluminous. 
To be done effectively it should be done by those who understand it 
and who have more than ordinary interest in it. Such persons can 
be found in every school system and when found, should be assigned 
to render this kind of service. No city should undertake educa- 
tional measurement without understanding that it involves some 
expenditure : a portion of this should be devoted to the securing of 
competent clerical assistance for statistical tabulations and another 
portion to the general direction and supervision of the work (by 
the superintendent of schools in the smaller cities and by a special 
school official in the larger cities). 

After the various tabulations and summaries have been made 
by grades, by schools, and for the city as a whole, the results must 
be interpreted. This is one of the most important phases of educa- 
tional measurement. On the interpretation of the results really 
depends the usefulness of the tests. One of the greatest dangers 
involved in educational measurement throughout the country today 
is the fact that many persons are giving tests who are not com- 
petent to tabulate and interpret the results. In general, interpreta- 
tion should be made by the superintendent, or by some other school 
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CHAPTER V 

BUREAUS OF RESEARCH IN CITY SCHOOL SYSTEMS 



EUQKNE A. NiFSNECKKB 

Aflsistaiit Director, Bureau of Beseareh and Bef erence, New ToriL Citj 



The city bnrean of educational research is the direct and logi- 
cal outcome of the combination of the survey movement and the 
movement for the use of measurement. A careful appraisal by a 
group of experts from without has been demanded and paid for by 
community after community. Very evidently such stock-taking is 
regarded by the public as beneficial in its effects. Too often, how- 
ever, the result, as far as the local schoolmen are concerned, has been 
disastrous. The time spent by the experts in the local field is nec- 
essarily short, their knowledge of local conditions necessarily lim- 
ited and their interpretation of results has sometimes seemed to lo- 
cal school officials unwarranted and unjust. More often than not, 
superintendents have attempted to explain away the defects re- 
vealed and to make light both of the facts and of the recommenda- 
tions of the survey experts. But facts are stubborn things, and 
changes of superintendents and upheavals and reorganizations of 
various sorts have inevitably followed the adoption of such a policy. 
So it has come about that many times a survey report has been of 
more direct benefit to schoolmen in other cities than to those in the 
city for which it was made. 

Thoughtful superintendents have come to see that, above every- 
thing else, the best insurance against the survey lightning is a sur- 
vey conducted from within. Many a schoolman has asked himself 
the searching questions: **What would a survey reveal about my 
school system? On a factual basis, what do I really know about my 
own workt" Straightway he ha^ begun himself to investigate. The 
various types of studies made in a modem survey are repeated on a 
smaller scale. Measurements are made and constructive attempts at 
remedial adjustments are begun. 
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The average administrator, however, is a busy man. He has 
little time, and by virtue of his training and position, little aptitude 
for close analytical studies or statistical investigation. Ordinarily 
he himself does just enough to realize the importance and value 
of the work, then delegates it to a specially trained person who 
works under his direcftion. In the smaller towns and cities this per- 
son may be only a clerk or bookkeeper who performs the mathemat- 
ical and statistical labors involved. In the medium-sized cities a 
supervisor or assistant superintendent is often detailed to give part 
or all of his time to the work, and in the larger cities there are for- 
mal organizations of special research departments. 

One of the best formulations of the functions of such research 
work is to be found in the report of the Committee on School In- 
quiry, New York City. Professor E. C. Elliott in his study of the 
administration of the New York Schools^ made among others the 
following recommendation: 
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Recommendation III 



^'That there be established as an integral part of the system of 
school control, a Bureau or Division of Investigation and Appraisal. 

'^This bureau or division should be in charge of a chief or 
superintendent, who is directly responsible to the Board of Edu- 
cation, and should be organized in such a manner as to enable it 
to serve as the central agency for the gathering and interpretation 
of statistical and other data with reference to the schools ; and also 
for the carrying on of such investigations as are necessary for the 
rational development and expansion of the school systeuL It should 
bear the same general relation to the Department of Education as 
the existing Bureau of Municipal Investigation' and Statistics bears 
to the Department of Finance. 

"The following arguments may be indicated: 

" (1 ) The school system of the city suffers from a lack of defi- 
nite, detailed knowledge of its own working and its own cost. As 
has already been pointed out, the fundamental importance of the 
inspectoriid form of control has been recognized only to a very lim- 
ited extent. And even where its importance is recognized, officials 
charged with the responsibility for administrative or supervisory 
duty appraise their own i)erf ormances. Investigation that is needed 
is not carried on at all. 



^Beport on Educational Aspects of Public School System of the City of 
New York to the Committee on School Inquiry of the Board of Estvnafte and 
Apportionment, Volanie 11, page 401. 
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'' (2) It is evident that one of two things will result in the 
immediate fatore. Either the work indicated for this proposed 
bureau will be attempted by agencies outside of the school (gfystem 
or dse there must be established, within the school Gfystem, as an 
integral part of its organized control, an agency properly equipped 
with trained investigators to set forth to the supervisory and ad- 
ministrative officials of the school system, and the people of the 
city, those essential facts absolutely necessary for tiie intelligent 
development of schools and of public sentiment. Of these alterna- 
tives, it would seem that the| latter is to be greatly preferred. No 
outside agency could carry forward the work of inspection and of 
formulating impartial judgments of results, and of proposing new 
procedures without much friction and loss of energy. 

" (3) The problems of public education in New York City are 
not conventional problems. Many of the more pressing ones are 
new in the social and educational world. They cannot be solved by 
preconceptions, or the showing of hands. In so far as possible, 
the situation and causes that have generated these problems must 
be weighed and analyzed before rational and permanent solutions 
can be found." 

This recommendation was immediately acted upon. A Division 
of Reference and Research was formally organized and began its 
work at the opening of schools, September, 1913. The quotation 
above, therefore, is of historical interest. For while the New York 
Bureau by no means represents the beginning of systematic, scien- 
tific study of school problems by school authorities, it was undoubt- 
edly the first to be definitely organized for that sole purpose. 

The real beginning of the movement that has led to the es- 
tablishment of bureaus of research cannot be clearly traced. In 
some cities there have been for many years committees, bureaus and 
special commissions for the more or less systematic study of build- 
ings, of children, of teachers, of instruction, and of many other 
forms of school activities. As rapidly as the movement for meas- 
urement has developed, the investigations of these agencies have be- 
come more and more truly scientific. Even today the organization 
and function of a bureau of research are not clearly defined, and all 
sorts of studies are being carried on by all types of workers. In some 
cities, the department consists of little more than a high-sounding 
title bestowed as a compliment upon some existing school officer. In 
others, the director of the bureau is given the rank and salary of an 
assistant superintendent and is a real director of an extensive de- 
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partment. Between these two extremes every type of yariation may 
be found. 

It is not sarprising, therefore, that the actual work of a bureau 
of research varies from city to city, being determined in the main by 
the tastes and training of the director, and somewhat by local needs. 
In some cities attention has been given almost wholly to a study of 
costs and to purely administrative problems; in other cities the en- 
ergy of the department has been expended only on the measurement 
of educational products ; in still others the deliberate attempt has 
been made to do some work in every field. In general, the tendency 
seems to be to regard the special function of the department as the 
devising, giving, scoring, tabulating and interpreting of standard 
tests and the prosecution of such other investigations only as may 
aid in the interpretation of the results secured. 

A city department of research ordinarily consists of a director 
and clerical or stenographic assistants. At first, the tendency was 
to select any capable schoolman available, with little regard for his 
qualifications for the special work, but later appointees, either as 
directors or assistants, have been young men or women specially 
trained in statistical methods and in educational measurements. The 
director, almost without exception, is responsible directly to the 
superintendent and under his immediate control. The salaries paid 
range from $1,100 to $6,000, (median of 13 cases $2,700). 

It has proved very difficult to obtain complete information with 
regard to the number of cities which have organized bureaus or 
which are carrying on organized work in measurement.' In spite 
of repeated questionnaires and persistent efforts, only a most tenta- 
tive list can be given. However, formal organizations are found in 
the cities listed on the following page. 

No attempt has been made to list cities in which research work 
is being carried on without formal organization, because of the im- 
possibility, both of making the list at all complete and of distinguish- 
ing between a mere incidental use of tests once from idle curiosity 
and their persistent, intelligent use, year after year, for worthy 
ends. Seattle, for instance, does all the work and has all the benefit of 
a bureau of research, but has no formal organization. The assistant 

The yarions fanctioiui of a bnrean of research are illustrated in other 
chapters, and the discussions wiU not be repeated here. 
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PABTIAL LIST OF CITY HUBBAXJB OF BE8EABCH 









When Name of 




City 


Title of Bureau 


Organ- Diieetor 
ised 


1. 


Baltimore. Md. 


Bureau of Statistics and 






r 


Besearch 


Edwin Hebden 


2. 


Boflton, Mass. 


Department of Education- 
al Investigation and 








Measurement 


1914 Frank W Ballon 


3. 


Bnffalo, N. Y. 


Bureau of Besearch 


1916 Wm. A. Mackey 


4. 


Chicago, 111. 


Department of Standards 








and Statistics 


1917 S. B. Allison 


5. 


Cleveland, Ohio 


Department of Beference 








and Besearch 


1916 C. W. Sutton 


6. 


Detroit, Michigan 


Department of Educa- 








tional Bewarch 


1914 S. A. Coortia 


7. 


Hibbing, Minn. 


Department of Educa- 








tional Besearch 


1915 J. W. Bichardson 


8. 


Kansas Citv, Mo. 


Bureau of Besearch and 






~ r 


Efficiency 


1914 Geo. Melcher 


9. 


Louisville, K7. 


Psychological Laboratory 


1914 Henrietta V. Baee 


10. 


Los Angeles, CaL 


Division of Besearch 


1917 Bobert Lane 


11. 


New York City 


Bureau of Besearch and 








Beference 


1913 E. A. Nifeneeker 


12. 


New Orleans, La. 


Bureau of Educational 








Besearch 


1912 (Discontinued) 


13. 


Oakland, Cal. 


Bureau of Beference and 








Besearch 


1914 VirgU E. Dickson 


14. 


Omaha, Neb. 


Bureau Educational 








Besearch 


1917 H. W. Anderson 


16. 


Bochester, N. Y. 


Efficiency Bureau 


1912 J. P. CHem 


16. 


St. Paul, Minn. 


Bureau Besearch and 








Efficiency 


1917 L. L. Everly 


17. 


Schnectady, N. Y. 
Topeka, Ks. 




1913 H. L. Davenport 


18. 


Bureau Besearch and 






Efficiency 


1916 Ira J. Bright 



superintendent in charge is a director of educational research in all 
but name. There are a large number of such cities throughout the 
United States. At the other extreme is the superintendent or 
teacher whose curiosity is stimulated by some talk or article, and 
who gives a test once to a single class. The sales of standard tests 
have grown to very great proportions. Last year, of a single popu- 
lar test, nearly 900,000 were used, and the annual sale of a few other 
tests run well over 100,000 copies each. Nor is the use of tests con- 
fined to this country. Shipments are made to all quarters of the 
world. It seems quite probable, therefore, that the number of bu- 
reaus of research are destined to be greatly increased in the im- 
mediate future. 



CHAPTER VI 

COOPERATIVE WORK PROM A UNIVERSITY CENTER 



EENXST J. ASHBAUOH 

Director Edneational Service, Extension Division^ State Universitj of Iowa 



One of the most significant developments in the university in 
the last twenty years has been the growth of the idea of service — 
service not only to the comparatively few who were able 
to come to the campus, but service to the many who were not able 
to come. The idea was developed largely in state universities, where 
the funds for support came from direct taxation of all the people of 
the state and where the leaders came to realize that the service of 
the university should be extended to all who were taxed to support 
it. Only recently, however, has the university as a whole made an 
organized effort to educate all the people in its territory and to ren- 
der service in the solution of the problems of its supporters off the 
campus. In fact, some of our state universities are doing almost 
nothing in these lines at the present time. 

One of the very latest lines of service to be developed is that 
of cooperative educational research. The movement is so com- 
pletely in its infancy that the method and the organization of the 
work have been but imperfectly worked out. However, two aims 
are rather definitely agreed upon by those engaged in this work, 
namely : (1) to make the university bureau a center for the direc- 
tion of cooperative work with the school people of the state in the 
solution of the problems in which the latter are most interested 
(2) to make the bureau an agency for the collection of rough data 
for the tabulation, organization, and interpretation of these data 
and for the distribution of the results of the study to the people 
contributing and to others, in order that significant facts may be 
known by the workers in the field. 

A third aim might be added (though it must necessarily be sub- 
servient to the other two) — ^that of gathering masses of scientific 
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data wMch may be used in the further study of educational prob- 
lems. 

Nearly all problems connected with public-school work will lend 
themselves to cooperative research when once the universily and the 
school people in the state come to a dose understanding. The early 
efforts in the collection of data on school attendance, age-grade and 
age-progress studies, school health and causes of absence, the use ot 
standard tests in arithmetic, reading, spelling, etc. ; the figuring of 
unit costs of instruction and scoring of buildings and physical 
equipment — together represent but a small portion of the field that 
may be entered with profit 

The length of the period of compulsory schooling is increasing, 
but it does not suffice merely to attend longer. Much needs to be 
known concerning the extent to which communities and states are 
fulfilling their obligation to all their children — ^the obligation of giv- 
ing them seven to twelve years of educational opportunity of a Idnd 
which will function in self-support and a wholesome social attitude. 
We need to know not only the extent to which this opportunity is of- 
fered, but also the extent to which this opportunity is being utilized. 
Cooperative research from a university center could obtain tlus 
knowledge. 

We are in a time of critical questioning concerning the mater- 
ials of education and the quality of the product turned out by our 
schools. The whole field of the school curriculum is open for re- 
search. Experimental methods certainly ought to be used in de- 
termining such things as time allotment, material to be used in each 
of the various grades and the arrangement of this material through- 
out the course. It is possible that method of presentation might also 
be included. This experimentation could be advantageously di- 
rected in cooperating schools by the university research bureau. 
Each problem would be specifically stated and the technique of 
procedure worked out at the university. The bureau would have 
the constructive criticism of the faculty in education and the pre- 
liminary experimentation would be carried on in the university 
experimental school. This would prepare the way for most effect- 
ive work in the public schools which were cooperating with the bu- 
reau. As results were secured, each advanced step would thus be- 



COOPBBATIVB WOBK FBOM A VNIVBBBITY CBNTBB 59 

come immediately available to all the schools of the state. Many 
city superintendents are experimenting along some of these lines, 
but their experiments are not coordinated. Cities having bureaus 
of research are doing more extensive and critical work. But under 
the leadership of the universily it would be possible to conduct 
such experiments under the varied conditions of small and large 
city, with the typical schoolroom conditions of each, and thus render 
a service to all communities in the state. 

It is not the purpose of this chapter to list all the problems 
of cooperative research nor to give in detail the manner of solution. 
The purpose is rather to state the aims of a research bureau in a 
university center and to note very briefly some of the larger fields 
that await attack. 

Development of the Iowa Bureau of Educational Service 

Method — The fundamental aims noted above have been kept 
constantly in mind in the development of the Bureau of Educa- 
tional Service in the Extension Division of the University of Iowa. 
The work was started in the fall of 1914, and the writer has been in 
charge of the work since its beginning. Some time was spent in 
traveling over the state and talking with the superintendents and 
thus learning at first-hand the most promising lines for initial en- 
deavor. 

The field had been partially prepared by courses in tests and 
measurement given in the College of Education during the preced- 
ing two years. Schoolmen attending the University had gained 
some knowledge of school surveys and some interest in cooperative 
work. The hearty cooperation of the faculty in education has been 
one of the greatest assets of the Bureau. In classroom, in institutes, 
and at teachers' associations they have furthered the work through 
frequent reference to the Bureau and its activities. The director of 
the Bureau holds rank in the College of Education and is a member 
of the instructional staff during the summer session. He thus 
comes in contact with the superintendents and principals who take 
summer work and assists in training them for further work in the 
field. 
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The annual conference on supervigion, held at the Univeraily 
under the joint auspices of the Extension Division and the CMIege 
of Education, has contributed much to the development of the woik 
It has brought together a group of school people (increasing in 
number from year to year) who are primarily interested in the 
problems of supervision. Such men as Judd, Strayer, CofEman, 
Ayres, Bagley and others have appeared upon the programs and 
promoted the interest in scientific education. The director of the 
Bureau has had a place at one general session each year and pre- 
sented the results of research studies. At this conference, at the^ 
State Teachers' Association and at the sectional educational meet- 
ings each year, the director has met superintendents, principals and 
teachers in general sessions and round-table discussions. He has 
also met another group of men and women, the county sai>erin- 
tendents. These persons, almost the only supervisors of the roral 
teachers, are becoming more and more interested in measorement 
of results, and their cooperation is being secured. 

In a word, the secret of the development of the Iowa Bnreau 
has been in the establishment of cordial cooperative relations with 
the various educational agencies of the state. 

Fields — ^The first research problem attacked was that of at- 
tendance and the second,the measurement of school progress through 
the use of standard tests. In February, 1915, an arrangement was 
made with Mr. S. A. Courtis whereby the Bureau has exclusive con- 
trol of his Series B tests in the state. In November of the same year a 
similar arrangement was made for the handling of the Kansas Silent 
Beading tests. These arrangements are still in force. Meanwhile, 
the Bureau has kept a small quantity of other tests on hand and 
stood ready to secure any others upon request. In addition to fur- 
nishing the superintendents of the state with the test material at 
cost, the Bureau has stood ready to give personal service in the giv- 
ing of these tests. The writer has gone into a number of schools and 
demonstrated to the superintendents and principals the method of 
giving, scoring, and interpreting the results of these tests. This has 
resulted in the schoolmen becoming very much interested in the new 
field of tests and measurement. Many of these men and women have 
since studied at the University to increase their knowledge along 
these lines. 
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A third activity developed has been an information service 
by which the Bureau attempts to give, through its contact with the 
various departments of the University, technical information on 
any problem connected with the schools of the state. Questions on 
buildings, heating, lighting, ventilation, playgrounds, health ser- 
vice, course of study, census, finance, etc., have come from school 
boards, superintendents, teachers and patrons, and the Bureau has 
transmitted to the inquirers the best information available. 

Another feature of the work of the Bureau has been local 
school surveys. On joint invitation of the school board and super- 
intendents, a survey of any phase of a local school problem will be 
carefully made, the results analyzed and recommendations rendered. 
Care is taken here not to encroach upon the field of legitimate pri- 
vate enterprise. For example, service that belongs definitely to the 
field of an engineer, architect, or public accountant is not given. 

Present Status op Work 

As a result of the activity of the Bureau during the three and a 
half years of its existence, its status has been quite firmly estab- 
lished. At first there was a question in the minds of many, both in 
and out of the university, whether such a bureau was a legitimate 
part of the activity of a university and perhaps even more of an 
Extension Division. At present the doubt no longer exists in Iowa. 
The Bureau, through its service to the superintendents and school 
boards, has settled this question affirmatively. 

It is understood at the University that it is the function of the 
Bureau of Educational Service to conduct researches in the field 
of education looking toward the promotion of efficiency in school 
work. All reasonable assistance will be given by various departments 
and colleges of the University to the furtherance of this work. This 
cooperation has been secured through a sincere effort to ask only rea- 
sonable assistance and to give full credit to the college, department 
or individual which rendered assistance to the Bureau. 

The relation of the school people of the state to the Bureau has 
always been that of voluntary cooperation. No system of university 
credit for work done or other means of stimulating their cooper- 
ation has been offered. At all times there has been a definite under- 
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data which may be used in the farther study of educational prob- 
lems. 

Nearly all problems connected with public-school work will lend 
themselves to cooperative research when once the university and the 
school people in the state come to a dose understanding. The early 
efforts in the collection of data on school attendance, age-grade and 
age-progress studies, school health and causes of absence, the use of 
standard tests in arithmetic, reading, spelling, etc. ; the figuring of 
unit costs of instruction and scoring of buildings and physical 
equipment — together represent but a small portion of the field that 
may be entered with profit 

The length of the period of compulsory schooling is increasing, 
but it does not suffice merely to attend longer. Much needs to be 
known concerning the extent to which communities and states are 
fulfilling their obligation to all their children — ^the obligation of giv- 
ing them seven to twelve years of educational opportunity of a kind 
which will function in self-support and a wholesome social attitude. 
We need to know not only the extent to which this opportunity is of- 
fered, but also the extent to which this opportunity is being utilized. 
Cooperative research from a university center could obtain this 
knowledge. 

We are in a time of critical questioning concerning the mater- 
ials of education and the quality of the product turned out by our 
schools. The whole field of the school curriculum is open for re- 
search. Experimental methods certainly ought to be used in de- 
termining such things as time allotment, material to be used in each 
of the various grades and the arrangement of this material through- 
out the course. It is possible that method of presentation might also 
be included. This experimentation could be advantageously di- 
rected in cooperating schools by the university research bureau. 
Each problem would be specifically stated and the technique of 
procedure worked out at the university. The bureau would have 
the constructive criticism of the faculty in education and the pre- 
liminary experimentation would be carried on in the university 
experimental school. This would prepare the way for most effectr 
ive work in the public schools which were cooperating with the bu- 
reau. As results were secured, each advanced step would thus be- 
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come immediately available to all the schools of the state. Many 
city saperintendents are experimenting along some of these lines, 
but their experiments are not coordinated. Cities having bureaus 
of research are doing more extensive and critical work. But under 
the leadership of the university it would be pooedble to conduct 
such experiments under the varied conditions of small and large 
city, with the typical schoolroom conditions of each, and thus render 
a service to all communities in the state. 

It is not the purpose of this chapter to list all the problems 
of cooperative research nor to give in detail the manner of solution. 
The purpose is rather to state the aims of a research bureau in a 
university center and to note very briefly some of the larger fields 
that await attack. 

Development of the Iowa Bureau of Educational Service 

Method — The fundamental aims noted above have been kept 
constantiy in mind in the development of the Bureau of Educa- 
tional Service in the Extension Division of the University of Iowa. 
The work was started in the fall of 1914, and the writer has been in 
charge of the work since its beginning. Some time was spent in 
traveling over the state and talking with the superintendents and 
thus learning at first-hand the most promising lines for initial en- 
deavor. 

The field had been partially prepared by courses in tests and 
measurement given in the College of Education during the preced- 
ing two years. Schoolmen attending the University had gained 
some knowledge of school surveys and some interest in cooperative 
work. The hearty cooperation of the faculty in education has been 
one of the greatest assets of the Bureau. In classroom, in institutes, 
and at teachers^ associations they have furthered the work through 
frequent reference to the Bureau and its activities. The director of 
the Bureau holds rank in the College of Education and is a member 
of the instructional staff during the summer session. He thus 
comes in contact with the superintendents and principals who take 
summer work and assists in training them for further work in the 
field. 
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The annual conference on supervision, held at the University 
under the joint auspices of the Extension Division and the College 
of Education, has contributed much to the development of the work. 
It has brought together a group of school people (increasing in 
number from year to year) who are primarily interested in the 
problems of supervision. Such men as Judd, Strayer, Coflbnan, 
Ayres, Bagley and others have appeared upon the 'programB and 
promoted the interest in scientific education. The director of the 
Bureau has had a place at one general session each year and pre- 
sented the results of research studies. At this conference, at the' 
State Teachers' Association and at the sectional educational meet- 
ings each year, the director has met superintendents, principals and 
teachers in general sessions and round-table discussions. He has 
also met another group of men and women, the county superin- 
tendents. These persons, almost the only supervisors of the rural 
teachers, are becoming more and more interested in measurement 
of results, and their cooperation is being secured. 

In a word, the secret of the development of the Iowa Bureau 
has been in the establishment of cordial cooperative relations with 
the various educational agencies of the state. 

Fields — ^The first research problem attacked was that of at- 
tendance and the second,the measurement of school progress through 
the use of standard tests. In February, 1915, an arrangement was 
made with Mr. S. A. Courtis whereby the Bureau has exclusive con- 
trol of his Series B tests in the state. In November of the same year a 
similar arrangement was made for the handling of the Kansas Silent 
Beading tests. These arrangements are still in force. Meanwhile, 
the Bureau has kept a small quantity of other tests on hand and 
stood ready to secure any others upon request. In addition to fur- 
nishing the superintendents of the state with the test material at 
cost, the Bureau has stood ready to give personal service in the giv- 
ing of these tests. The writer has gone into a number of schools and 
demonstrated to the superintendents and principals the method of 
giving, scoring, and interpreting the results of these tests. This has 
resulted in the schoolmen becoming very much interested in the new 
field of tests and measurement. Many of these men and women have 
since studied at the University to increase their knowledge along 
these lines. 
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A third activity developed has been an information service 
by which the Bureau attempts to give, through its contact with the 
various departments of the University, technical information on 
any problem connected with the schools of the state. Questions on 
buildings, heating, lighting, ventilation, playgrounds, health ser- 
vice, course of study, census, finance, etc., have come from school 
boards, superintendents, teachers and patrons, and the Bureau has 
transmitted to the inquirers the best information available. 

Another feature of the work of the Bureau has been local 
school surveys. On joint invitation of the school board and super- 
intendents, a survey of any phase of a local school problem will be 
carefully made, the results analyzed and recommendations rendered. 
Care is taken here not to encroach upon the field of legitimate pri- 
vate enterprise. For example, service that belongs definitely to the 
field of an engineer, architect, or public accountant is not given. 

Present Status op Work 

As a result of the activity of the Bureau during the three and a 
half years of its existence, its status has been quite firmly estab- 
lished. At first there was a question in the minds of many, both in 
and out of the university, whether such a bureau was a legitimate 
part of the activity of a university and perhaps even more of an 
Extension Division. At present the doubt no longer exists in Iowa. 
The Bureau^ through its service to the superintendents and school 
boards, has settled this question afi&rmatively. 

It is understood at the University that it is the function of the 
Bureau of Educational Service to conduct researches in the field 
of education looking toward the promotion of efficiency in school 
work. AU reasonable assistance will be given by various departments 
and colleges of the University to the furtherance of this work. This 
cooperation has been secured through a sincere effort to ask only rea- 
sonable assistance and to give full credit to the college, department 
or individual which rendered assistance to the Bureau. 

The relation of the school people of the state to the Bureau has 
always been that of voluntary cooperation. No system of university 
credit for work done or other means of stimulating their cooper- 
ation has been offered. At all times there has been a definite under- 
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Standing between the director of the Bureau and the superinten- 
dents that each superintendent should decide for himself whether he 
ought to cooperate in any proposed research. If he believed that 
the result of the research would be sufficiently valuable to his own 
school to justify the expenditure of the time and effort required, 
the Bureau would be very glad to receive his contribution. If he 
did not believe this would be the case,the most friendly relationahip 
was maintained, and the invitation was repeated when another line 
of research work was undertaken. Thus, each superintendent in 
the state has come to look upon the Bureau as asking for only such 
assistance as shall contribute directly to the solution of his own 
problems. 

Results Accomplished 

The results accomplished fall rather definitely into three 
groups, according as they pertain to (1) state-wide surveys, (2) 
local surveys, and (3) general service. 

State-wide Surveys — 

(1) A state-wide survey of handwriting involving 110 cities 
and towns and rural pupils from fourteen counties was made in 
1915 and the results issued in bulletin form.^ The following six 
questions were asked and answered on the basis of the information 
secured by the survey : 

1. How well do Iowa school children write! 

2. Do children improve their quality of writing regularly 
as they progress through the grades? 

3. Do children attending school in towns and cities write bet- 
ter than those attending the rural schools? 

4. Do the children in the larger cities write better than those 
in towns or smaller cities? 

5. How do children in this state compare with children in 
other states? 

6. Is the quality of writing of the average eighth-grade child 
sufficient to satisfy the ordinary demands of every-day life outside 
of school? 

The samples of writing were scored by the Ayres Handwriting 

Scale^ and the conclusions were as follows : 

*E. J. ABhbangli, Handwritiiig of Iowa School Children, Extension Bui" 
letin. No, 16, State Vimereity of Iowa. 

"Leonard P. Ayres, A MeaeuHng Scale for Handwritiiig, BnaseU Sage 
Foundation. 
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1. Iowa school children in the eight grades write approxi- 
mately at Qualities 30, 35, 40, 45, 50, 52, 57, and 60, respectively, 
on this scale. Reference to the scale is necessary to understand the 
means of these values. 

2. Yes. The improvement is quite uniform through the lower 
grades, but less rapid in the upper. 

3 and 4. No. The differences between the quality of writing 
of children attending the rural schod, small town and cities are 
negligible. 

5. On the average, Iowa children are writing as well as chil- 
dren of like grade elsewhere in the United States. 

6. Apparently the quality of writing of the majority of eighth- 
grade children will satis^ the ordinary demands of daily life, since 
75 percent of these children write a better quality than is required 
by the New York Municipal Civil Service Commission. 

(2) A similar survey of achievement in the fundamentals of 

arithmetic as measured by the Courtis Series B tests was made in 
1916 and the results distributed in a bulletin.^ The following four 
questions were proposed and answered in this bulletin : 

1. How sBUful are Iowa children in performing the four fun- 
damental operations in arithmetic? 

2. How does the skill of Iowa school children compare with 
that of children of like grades in other states? 

3. How does the skill of children in small towns compare with 
that of children in larger towns and cities? 

4. What use can be made of Standard Tests ? 

1. The median speed and accuracy of children were ascer- 
tained in each of the grades. Mr. Courtis' standard as well as the 
scores of each of the cities contributing data was furnished for 
purposes of comparison. The evidence indicated that more speed 
was needed in the upper grades and greater accuracy in all. 

2. Iowa school children were shown to excel in most grades and 
operations when their scores were compared with the - available 
records of sister states. 

3. While, in general, the scores of pupils in smaller towns are 
lower than those of pupils in larger places, the records of some small 
towns showed clearly that size of place is not a determining factor. 

On the basis of these showings many schools in the state have 
modified their courses in order to give greater attention to drill 
work in fundamentals. 



"E. J. Aflhbaagh, Aritlimetieal Skill of Iowa School Childreii,27fl?<0iMiofi 
BttOettn, No 24, State University of Iowa. 



^^.^^tttmimttmii^mt^^k^c:. 
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(3) Less elaborate studies have been made of achievement in 
reading and spelling, attendance, causes of absence and teachers' 
marks. In reading and spelling, the general state situation seems to 
be average or slightly above when compared with other states. 
Individual cities have discovered weaknesses through these sarveys 
and modified their practice accordingly. The attendance sonrej 
showed an amount of absence almost incredible to superintendents 
and teachers — ^20 percent of the children out more than 10 percent 
of the time; 10 percent of the children out more than 20 x>ereent 
of the time; 6.6 percent of the children out more than 30 percent 
of the time — not a satisfactory situation. High 'percentages of 
attendance' have been secured through the method of dropping a 
child's name from the roll after a period of a day and a half to 
three days' absence. This, however, does not make for increased 
school attendance by the child. 

In all these studies the random selection of cities and the large 
number of pupils involved makes it probable that the results are 
typical of the state. Definite readjustments are known to have 
been made in a number of school systems on the basis of the facts 
revealed. 

Local Surveys — 

(1) In response to direct invitations by superintendents and 
school boards, more or less complete surveys of four Iowa school 
systems have been made. Written reports have been rendered to 
the school boards in each case. 

(2) Building surveys involving the question of utilization of 
present buildings and the best solution for caring for the increased 
school population have been conducted in three cities. 

Local surveys are possible only by the closest cooperation with 
teachers, superintendents and school boards. Meetings with teach- 
ers are arranged where the results of the surveys of instruction are 
given and the interpretation is carefully explained. These meetings 
enable the teachers to apply the survey results so as to increase class- 
room efficiency. Meetings with the school board are also arranged 
so that information may be given them that will help them to ful- 
fill their functions to the greater good of the schools. 
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General Service — 

(1) The various standard tests have been furnished at cost to 
the schools of the state. This has kept the Bureau in touch with all 
schools doing measuring work and fostered the cooperative rela- 
tionship. 

(2) An informational service has been established which en- 
deavors to be a source of help in the solution of school problems. 
This service is free and open to anyone within the state. 

The response of the school superintendents of the state to 
any projected cooperative work, the lai^ number of calls for sur- 
veys of various kinds, and the utilization of the obtained results, 
furnish the best evidence of the value of the work that has been ac- 
complished. The fact that calls are still coming in for studies issued 
more than two years ago indicates that the work of the Bureau is 
considered as having more than temporary value. During the three 
years and a half cooperative relationship has been established with 
more than 100 different cities and towns of the state. At the pres- 
ent time I know that when an invitation is extended for cooperative 
work, a truly representative number of cities and towns can be 
relied upon to furnish the desired information. 

DlFElOUI/nES 

A fundamental difficulty, and one that often tends to invali- 
date results, is that a large number of teachers, principals and su- 
perintendents have not had an opportunity for training in scientific 
research work. With the very best intention to cooperate, direc- 
tions are frequently misunderstood or the importance of their being 
followed in an absolute manner is not appreciated and thus a vari- 
able factor enters into the work. This difficulty can be overcome 
only by extreme care and preliminary experimentation in the for- 
mulation of directions. 

Another problem, perhaps even greater than the securing of 
reliable data, is presented by the question : How shall the results 
of researches be reported in such a way that the greatest possible 
good may come to schools t The purpose of the research is the modi- 
fication of schoolroom practice. In most cases this will be accom- 
plished only when the results reach the teacher in a form which 
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formation of a bureau of cooperative research was the UniYersity 
of Oklahoma, in 1913. At this time, however, cooperative work was 
also under way in the University of Indiana, and the formal organi- 
zation of the Bureau of Cooperative Besearch took place the f (dlow- 
ing year. Similar bureaus at the University of Iowa and at the 
State Normal Scho<d, Emporia, Kansas, were organized a little later. 
A partial list of university bureaus of research (with sufficiently 
formal organizations to have stationery of their own!) is as follows: 



UniTenity 



Name of Bnreaa 



When 
Orgma- 



Name of 
Director 



UniT. of Arkiinsmi, 
Fajette, Ark. 

UiiiT. of Indiana, 

Bloomington, Ind. 
UniT. of Iowa, Iowa City, 

Iowa 
UniT. of Kansas, 

Lawrence, Elan. 
Univ. of Minnesota, 

Minneapolis, Minn. 
UniT. of Nebraska, 

Lincoln, Neb. 
UniT. of Oklahoma, 

Norman, Okla. 
UniT. of South Dakota, 

Vermillion, S. Dak. 



Borean of Educational 
Teste and Measure- 
ments 

Bureau of CooperatiTe 
Research 

Educational Service, Ex- 
tension Division 

Bureau of Educational 
Measurements 

Bureau of Cooperative 



Bureau of Educational 

Measurements 
Bureau of Measurements 

and EfBeiencj 
Bureau of Educational 

Beeearch 



1917 J. B. JeweD 
1914 (Position unfilled 
at present) 

1914 E. J. Aahbaugh 
1916 F. J. KeDy 

1915 M. E. Haggertj 

1914 Charles Fordjce 
1913 W. W. Phelaa 

1915 W. Franklin Jones 



It most not be supposed, however, that the universities that 
appear in the list above are the only ones actively supporting the 
movement. From Harvard and Columbia Universities in the east, 
to Leiand Stanford Junior University in the west, from the Uni- 
versity of Wisconsin in the north to the University of Texas in the 
south, similar work is being done by schools and departments of 
education. If a distinction is to be made at all, it is that the univer- 
sities that have formal bureaus usually act as distributing centers 
for testing material, but even this distinction does not always hold. 
The influence of university men in education has naturally been 
one of the main factors that have led to the growth of the movement 

The university, moreover, has by no means been the only factor. 
Normal schools and teachers' institutes have done their share. At 
present bureaus of research are to be found in at least two normal 
schools: 
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When Name of 
Normal School Name of Bureau Organ- Director 
jged 

State Normal School, Bureau of Educational 

Emporia, Ea. Standards and Meaa- 

urementa • 1914 Walter S. Monroe 

Northern Normal and Bureau of Educational 

Industrial School, Ab- Beeeareh 1917 Willia E. Johnson 

erdeen, So. Dak. 

Still another agency for the development of educational re- 
search throughout a state has been the state department of educa- 
tion. In at least three of these attention to research work is the 
special duty of a particular member of the staff. 

When Name of 
State Name of Bureau Organ- Director 
iged 

New York State Dept. of Education Wm. A. AyeriU 
Wisconsin State Board of Educa- 
tion 1915 B. B. Buckingham 
G^eorgia State Dept. of Georgia M. L. Duggan 

Probably this is the proper place, also, to comment on the aid 
rendered by the U. S. Bureau of Education. Bulletins and reports 
of committees on standard tests and scales have been printed ; sur- 
veys have been conducted, and in many ways the Bureau at Wash- 
ington has done what it could to further the cause of measurement. 

Finally, tribute must be paid to the influence of the great foun- 
dations. The Russell Sage Foundation, through its Division of Edu- 
cation, under the direction of Leonard P. Ayres, was the pioneer in 
this field and has been one of the major influences responsible for 
the rapid development of the movement for measurement. The 
Ayres Scales in writing and spelling are widely used, while the in- 
vestigations of the Division in the field of cost-accounting and child- 
accounting have had even greater influence. The survey work car- 
ried on by the Division has been a third type of activity that has 
had a great effect in directing the minds of school men to the possi- 
bilities of measurement. The contributions of the foundation to 
this field are very great. 

Of recent years, more and more attention has been given by 
other foundations to the field of educational research. The Cleve- 
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The standards given in several cases are tentative only and 
all are, of course, sabject to revision. Unless standard scores are 
based upon a large number of cases, they should be used with cau- 
tion in making comparisons. In all eases it should be remembered 
that any standard which is simply a statement of the conAsnsus of 
present practice is open to the criticism that we must not assume 
that what is, is what should be. For example, it may be that a high 
degree of efficiency requires a much higher standard in the rate of 
silent reading than the average rate at which children now read in 
the several grades. 

It should also be remembered that the scores upon which these 
standards are based were obtained by following certain definite 
directions in giving the several tests. Even slight variations in pro- 
cedure often materially affect pupils' scores. Hence, when compar- 
ison with standard scores is the object of the testing work, one 
should follow the standard, or specified, directions which in most 
cases accompany the tests. In any case, in making comparisons it 
is unwise to attach great importance to small differences in scores.^ 

An effort has been made to make this list as complete as possi- 
ble, but doubtless some tests have been overlooked, and it is certain 
that within a short time new tests will be announced. In fact, sev- 
eral were found that were in the process of derivation. Certain 
special tests which have been devised for laboratory research are 
intentionally omitted because they are not available for distribution 
and in general are not suitable for the type of testing the superin- 
tendent or teacher will do. Practice tests or other exercises which 
are primarily teaching devices have also been omitted. 

The tests may be obtained from the addresses given When no 
address is given, the tests are not available for general use. Even in 
a few cases where the address is given, the tests are not available. 
On account of recent fiuctuations in the cost of printing, prices are 
not stable. Accordingly, no prices are given. However, in only a 
few cases are the tests published on a commercial basis and for this 
reason one may be reasonably certain that the tests may be ob- 
tained at approximately the cost of printing. 



^S. A. Courtis, Third, Fowrth and Fifth Annual Acootmiings, 1913-1916. 
(Department of Cooperative Besearch, Detroit). Head especially the warning 
given on page 53. 
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Stahdabdieed Tests fob Use in the Eleuentabt School 
I. Arithmetic, Fondamental Operations 

1. Babbitt's AritTimetic Tests. These teste were used in the 
HQrvey of the public schools of San Antonio, Texas. They consist 
of nine teste, five for the operations with integers and fonr for the 
operations with common fractions. Each test is limited to one op- 
eration, bnt contains examples of several different types. However, 
the? are arranged in groups which are equal in difficulty. (Bef. 
546. )• 

2. Boston Tests. Addition of Fractions. These are a series 
of six teste devised by A. W. Eallora and are significant for the il- 
lustration they furnish of teste based upon a scientific analysis of 
the abilities they measure. This analysis revealed fourteen types 
of examples in the addition of two fractions, but by making certain 
combinations the number of teste needed to measure this group of 
abilities was reduced to six. A similar series has been devised for 
subtraction of fractions, and it is planned to extend the work to 
multiplication and division. (Ref. 78.) 







irunuMtM: 


BonOH HlDUKI 


ASDinOM 


» FMOnOMI 








1 


Tat 1 1 Tat Z 


Ten 8 1 TeM 4 | Te«t 6 


Tun 






&. 




Es 


3 


^R 


3 


S? 


a 


^3 


S 


Ss 


1 


I 


11 


II 


11 


II 


II 


ll 


II 


11 


11 


ll 


11 


ll 




























VII 




Ifl.S 


«fin 










noa 






fi.T 


4B.1 


Vlll 


HBO 


S0.7 1 88,2 


ll.B 















3. Cleveland Survey Tests. These were designed for use in 
the survey of the Cleveland Public Schools. They have been revised 
slightly and used in the surveys at Grand Rapids and St. Louis. 
The series oonsiste of fifteen tests, induding four in addition, two in 
subtraction, three in multiplication, four in division, and two in 
addition and subtraction of common fractions. The total w0T4dng 
time is 22 minutes and the administratioD of the teste is simple. 
They furnish a more detailed analysis than can be secured by means 
of the Courtis Standard Research Tests, Series B. Address Charles 
H. Judd, School of Edncation, University of Chicago, Chicago, 
niimnB, or S. A. Courtis, 82 Eliot St, Detroit (Ref. 403.) 

'Beferenee numbers in this ehaptei refer to Ihe nomben in 1^ UbUog- 
rsph^, Cbapter Xm. 
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4. Courtis Standard Tests, Series A. This series indndes 
eight tests, one for the combinations (0-9) in each of the operations; 
copying figures, speed reasoning, fundamental operations, and reas- 
oning. The series was devised in 1909 and was used extensiYelj 
during the following years. However, the author has discontinued 
its publication in favor of Series B, devised in 1913. (Bef. 91.) 



Standabd MiDiAN ScoBis. CouBTis' Stavdabo Bbsbaboh Tbstc, Saras B. 



Obadb 


Addition 


Subtraction 


Multiplication 


DtrialoiB 




Speed 1 Ace. 


Speed 1 Aco. 


Speed 


Ace. 


SpMdl Am. 


rv — General 

Courtis 

Boston 


7.4 

6 

8 


64 

100 

70 


7.4 

7 

7 


80 

100 

80 


6.2 

6 
6 


67 

100 

60 


4.6 

4 
4 


57 

100 

60 


V— General 

Courtis 

Boston 


8.6 

8 

9 


70 

100 

70 


9.0 

9 

9 


88 

100 

80 


7.6 

8 

7 


76 

100 

70 


6.1 

6 
6 


77 

100 

70 

• 


VI — General 

Courtis 

Boston 


9.8 
10 
10 


78 

100 

70 


10.8 

11 

10 


85 

100 

90 


9.1 

9 

9 


78 

100 

80 


8.8 

8 

8 


8 

100 

80 


VII— General 

Courtis 

Boston 


10.9 

11 

11 


76 

100 

80 


11.6 

12 

11 


86 

100 

90 


10.2 

10 

10 


80 

100 

80 


0.6 
10 
10 


80 

100 

80 


Vni — General 

Courtis 

Boston 


11.6 

12 

12 


76 

100 

80 


12.9 

18 

12 


87 

100 

90 


11.6 

11 

11 


81 

100 

80 


10.7 

11 

11 


81 

100 

80 



Speed is the number of examples done in the time allowed. 

Accuracy is the percent of examples correct. 

'*Genersl" medians were determined by Courtis on the basis of the 1016 talmlatknit 
and summaries of tabulations of other years. Courtis, S. A. Third, Fourth, and Fifth An- 
nual AefiounHna§, 1918-16, (Department of CooperatiTe Research, Detroit). 

Tie Boston standards were established after using the tests for three yeart. Balkra. 
F. W., Arithmetic, the Courtis SUndard Testa in Boston, 1912-15. (ButttHn N9, 19 ^ tkm 
Dv^rtmeni of Bdveationdl JnvottigaHon and Moaauroment) . 
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5. Courtis Standard Research Tests, Series B. This series of 
tests consists of one test in each of the four fundamental operations. >^ 
The tests measure the speed and accuracy with which the pupil 
can perform these operations with one type of example. The ad- 
ministration is very simple. The total time required to give them is 

26 minutes. They have been used extensively since their first pub- 
lication in 1914. The measures have been proved reliable in 75 
to 90 percent of the cases. Address S. A. Courtis, 82 Eliot St., 
Detroit, Michigan. (Befs. 77, 97.) 

6. OvJiin^s Number Tests. These tests include 88 combina- 
tions for both addition and multiplication. The standards are given 
in terms of the number of seconds required to complete the test. 
Address Hubb City School Supply Company, Aberdeen, South Da- 
kota. 

Standards. 3rd grade, 150 6th grade, 120 

4th grade, 140 7th grade, 110 

5th grade, 130 8th grade, 100 

7. Monroe^ s Diagnostic Tests. This series covers the four 
fundamental operations in integers, common fractions, and decimal 
fractions. It is thought that they will furnish a reasonably com- 
plete diagnosis of the abilities of pupils to perform the operations ^ 
of arithmetic. Although the series consists of -21 tests, they have been 

so arranged that the total time required for giving them is only 
35V^ minutes. Address Bureau of Educational Measurements and 
Standards, Emporia, Kansas. 

8. National Business Ability Tests. The tests for addition, 
subtraction and multiplication are abbreviated forms of the corres- 
ponding tests of the Courtis Standard Research Tests, Series B. In 
addition to these three, there are tests in multiplication of common 
fractions and in percentage. The standards are stated in terms of 
the number of minutes allowed for completing the respective tests. 
Address Sherwin Cody, Managing Director, 189 W. Madison St., 
Chicago, Illinois. 

9. Stone* s Arithmetic Test for the Fundamental Operations. 
This test is of historical interest because it was used by Courtis *^ 
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in the experimentation which resulted in the derivation of Series A. 
It was designed as a general test and has not been standardized ex- 
cept for the sixth grade. Address Bureau of Publications, Teach- 
ers College, Columbia University, New York City. (Ref. 138.) 

10, Thompson's Standardized Tests. This is an elaborate ser- 
ies of tests upon the operations of arithmetic. The feature of these 
tests is a mechanical device for scoring the papers. Address T. E. 
Thompson, Monrovia, California. 

11. Woody's Arithmetic Scales. These consist of two series 
of four tests, one for each of the fundamental operations. They 
differ from such tests as the Courtis Standard Research Tests, Ser- 
ies B, in that the examples in each scale have been carefully graded 
and arranged in order of difficulty. In content they include inte- 
gers, decimal fractions, common fractions and denominate num- 
bers.^ Series A and Series B are similar, except that Series A is 
more finely divided. Address Bureau of Publications, Teachers Col- 
lege, Columbia University, New York City. (Ref. 148.) 

Tbntativi Stakdabos 07 Aohhybmbnt fob Woody Tbsts, Sxbzbs A 
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Itecently there has appeared a modification of the Woody tests known as 
the Woodj-McCall Mixed Fundamentals, Series B, I and II. These teats are 
more difficult than the original Woody tests. Each sheet has on it problems in 
all four of the fundamental operations, so that the pupil must choose the right 
operation for each problem. In exploring for tests best fitted for selecting 
gifted children in the 5th and 6th grades I have found the Woody-MeCall 
Mixed Fundamentals distinctly better than the Woody tests from which tliej 
were derived. — G. M. W. 



EXISTING IBSTS AND 8TANDASD8 77 

The standards are expressed in terms of the degree of difficulty 
of the examples that are done correctly by just 50 percent of the 
pupils. 

II. Arithmetic : Reasoning 

1. Bonser^s Reasoning Tests. These consist of two lists of 
ten problems each. The problems have been chosen so that the two 
tests are equal in difficulty. Address Bureau of Publications, 
Teachers College, Columbia University, New York City. (Bef. 75.) 

2. Buckin^liam^s Reasoning Tests. These tests were devised 
for use in the survey of the Gary and Prevocational Schools of New 
York City. The problems of the tests were carefully evaluated and 
arranged so that the two lists are equally difficult, but were not sci- 
entifically selected. ( Ref s. 82, 466. ) 

3. Courtis^ Reasoning Tests. Tests 7 and 8 of the Courtis 
Standard Research Tests, Series A (^. t;.) are reasoning tests. 

4. Rice's Reasoning Tests. These were given by Rice in 1902 
and are of historical interest. They consist of a series of tests, one 
for each of the grades from fourth to eighth, inclusive. The prob- 
lems were selected as suitable for the pupils of the respective 
grades. (Ref. 129.) 

5. Starch's Arithmetical Scale A. This test consists of a 
series of arithmetical problems which are arranged in order of in- 
creasing difficulty. Address Daniel Starch, University of Wiscon- 
sin, Madison, Wisconsin. (Ref. 134.) 

The following are standard scores for the ends of the respective 
years, as derived from 2515 pupils in 18 schools : 

Grade Ill IV V VI VII VIII 

Score 4.5 6.2 7.8 9.4 11.0 12.6 

6. Stone's Reasoning Test. This is a single test designed to 
be given to Grades IV to VIII, inclusive. The problems have been 
carefully evaluated. The test was used in the survey of the public 
schools of Butte, Montana, and Salt Lake City, Utah. Address 
Bureau of Publications, Teachers College, Columbia University, 
New York City. 
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in the experimentation which resulted in the derivation of Seriies A. 
It was designed as a general test and has not been standardized ex- 
cept for the sixth grade. Address Bureau of Publications, Teach- 
ers College, Columbia University, New York City. (Ref. 138.) 

10. rhompson^s Standardized Tests, This is an elaborate ser- 
ies of tests upon the operations of arithmetic. The feature of these 
tests is a mechanical device for scoring the papers. Address T. E. 
Thompson, Monrovia, California. 

11. Woody^s Arithmetic Scales. These consist of two series 
of four tests, one for each of the fundamental operations. They 
differ from such tests as the Courtis Standard Research Tests, Ser- 
ies B, in that the examples in each scale have been carefully graded 
and arranged in order of difficulty. In content they include inte- 
gers, decimal fractions, common fractions and denominate num- 
bers.2 Series A and Series B are similar, except that Series A is 
more finely divided. Address Bureau of Publications, Teachers Col- 
lege, Columbia University, New York City. (Bef. 148.) 
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Itecently there has appeared a modification of the Woody tests known as 
the Woodj-McCall Mixed Fundamentals, Series B, I and II. These teste are 
more difficult than the original Woody tests. Each sheet has on it problems in 
all four of the fundamental operations, so that the pupil must chooee the light 
operation for each problem. In exploring for tests best fitted for selecting 
gifted children in the 5th and 6th grades I have found the Woodj-McOaU 
Mixed Fundamentals distinctly better than the Woody tests from which they 
were derived. — G. M. W. 
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The standards are expressed in terms of the degree of difficulty 
of the examples that are done correctly by just 50 percent of the 
pupils. 

II. Arithmetic : Reasoning 

1. Bonser^s Reasoning Tests. These consist of two lists of 
ten problems each. The problems have been chosen so that the two 
tests are equal in difficulty. Address Bureau of Publications, 
Teachers College, Columbia University, New York City. (Eel 75.) 

2. BtLckingJiam's Reasoning Tests. These tests were devised 
for use in the survey of the Gary and Prevocational Schools of New 
York City. The problems of the tests were carefully evaluated and 
arranged so that the two lists are equally difficult, but were not sci- 
entifically selected. (Befs. 82, 466.) 

3. Courtis^ Reasoning Tests. Tests 7 and 8 of the Courtis 
Standard Research Tests, Series A (^. t;.) are reasoning tests. 

4. Rice^s Reasoning Tests. These were given by Rice in 1902 
and are of historical interest. They consist of a series of tests, one 
for each of the grades from fourth to eighth, inclusive. The prob- 
lems were selected as suitable for the pupils of the respective 
grades. (Ref. 129.) 

5. Starches Arithmetical Scale A. This test consists of a 
series of arithmetical problems which are arranged in order of in- 
creasing difficulty. Address Daniel Starch, University of l^H^rcon- 
sin, Madison, Wisconsin. (Ref. 134.) 

The following are standard scores for the ends of the respective 
years, as derived from 2515 pupils in 18 schools : 

Grade Ill IV V VI VII VIII 

Score 4.5 6.2 7.8 9.4 11.0 12.6 

6. Stone's Reasoning Test. This is a single test designed to 
be given to Orades IV to VIII, inclusive. The problems have been 
carefully evaluated. The test was used in the survey of the public 
schools of Butte, Montana, and Salt Lake City, Utah. Address 
Bureau of Publications, Teachers College, Columbia University, 
New York City. 
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Recently Stone has issued the following standards: 
' ' That 80 percent or more of 5th-grade pupils reach or exceed a 
score of 5.5, with at least 75 percent accuracy ; that 80 percent or 
more of 6th-grade pupils reach or exceed a score of 6.5, with at 
least 80 percent accuracy; that 80 percent or more of 7th-grade 
pupils reach or exceed a score of 7.5, with at least 85 percent accur- 
acy ; that 80 percent or more of 8th-grade pupils reach or exceed 
a score of 8.75, with at least 90 percent accuracy." (Ref. 139.) 

• 

III. Drawing 

1. TJiorndike's Drawing Scale. This scale, devised by E. L. 
Thomdike, in 1913, consists of a series of drawings arranged in 
order of merit as determined by competent judges. Address 
Bureau of Publications, Teachers College, Columbia University, 
New York City. (Ref. 159.) 

IV. Geography 

1. The Boston Tests. The two tests of this series — one on the 
United States and the other on Europe — consist of well-chosen 
questions. The relative difficulty of the questions was determined 
upon the basis of the percent of correct answers. The tests were 
devised in an eflfort to determine: (1) the character of achieve- 
ment in geography and (2) the possibility of scientific measurement 
of educational results in geography. This significant comment is 
made : ' * The results show how inadequate the customary examina- 
tion or test in geography is to measure ability in geography." 
(Ref. 216.) 

2. Buckingham's Geography Test. This test was devised for 
use in the survey of the Gary and Prevocational Schools of New 
York City. It consist of two sets of 20 questions which were eval- 
uated upon the basis of the percent of correct responses. (Ref. 
466.) 

3. Hahn-Lackey Geography Scale. This scale consists of sev- 
eral hundred geographical questions which were found to be com- 
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mon to six modem texts and which satisfied certain other criteria. 
These questions have been classified according to difiiculty. In 
appearance the scale is very much like the Ayres' Spelling Scale 
and is to be used the same way. Address H. H. Hahn, Wayne State 
Normal School, Wayne, Nebraska. 

4. Starch's Geography Tests, Series A. The common elements 
of five geography texts have been arranged in five parallel tests. 
The exercises of the tests are in the form of mutilated sentences. 
Address Daniel Starch, University of Wisconsin, Madison, Wiscon- 
sin. 

5. Thompson's Standardized Tests in Geography. These con- 
sist of a test each for North and South America. They deal en- 
tirely with place geography. An important feature is a mechanical 
device for scoring the papers. Address T. B. Thompson, Monrovia, 
California. 

6. Witham's Standard Geography Tests. These are a series 
of tests arranged to test quickly and easily pupils' knowledge of 
certain geographical facts. The facts for the tests on the world 
are grouped under these heads: (1) geographical divisions, (2) 
form and motion of the earth, (3) the hemispheres, (4) land and 
water forms, (5) homes of the races, (6) industries, and (7) largest 
cities. Address E. C. Witham, Southington, Conn. (Bef. 221.) 

V. Handwriting 

The scales described below are used to measure the quality of 
handwriting. The speed of handwriting is measured by having 
suitable material written under specified conditions for a definite 
number of minutes. In order that a measurement of speed may be 
most significant, it must be made when the quality of the pupil's 
handwriting is approximately standard. 

' ' Pupils should be asked to write a suitable selection which they 
have memorized. To guard against lapses of memory, the pupils 
should be asked to repeat in concert the selection to be used. If 
convenient, it is well to provide each pupil with a printed or type- 
written copy of the selection. When this cannot be done, the se- 
lection may be written on the blackboard where all can see it. The 
selection should contain no words which the pupils cannot spell 
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readily. It is well to have them practice writing the more diflfeult 
words before the test is begun. Do not use material which the pu- 
pils must compose as they write, for this would be worthlees in tot- 
ing. The rate of writing unfamiliar material from a printed eopj 
will vary with the pupils' rate of reading and so will not give a 
true measure of speed. Dictated material should be used cnily 
when the teacher wishes to control the speed, not when speed is to be 
measured. 

''Different investigators have required pupils to write different 
material. Several have used the first line or the first stanza of the 
poem, 'Mary had a little lamb.' 'Sing a Song of Sixpence' has 
been used. Other sentences which have furnished copy are 'Jolly 
kings bring gifts while happy maids dance.' 'A quick brown fox 
jumps over the lazy dog. ^ ' Then the carelessly dressed gentleman 
stepped lightly into Warren's carriage and held out a small card. 
John vanished behind the bushes and the carriage moved along 
down the driveway. '* In the Cleveland Survey the first three een- 
tenccs of Lincoln's Gettysburg Address were written, and Ayres 
has used the same selection in the 'Gettysburg Edition' of his scale. 
In several surveys the pupils were allowed to write any familiar 
stanza of a poem. The chief principles to bear in mind in selecting 
materials are : first, to use material in the lower grades which wiU 
not furnish difficulties in spelling and remembering; and second, 
to use material which will be uniform in all classes which are to 
be compared."* 

1. Ayres* Scale for Measuring the Handwriting of School 
Children. This is known as the "Three Slant Edition," or more 
simply as the Ayres Scale. It consists of three types of specimens 
of the handwriting of school children — ^vertical, semi-slant and full 
slant — arranged in order of legibility as determined experimentally. 
I The values 20, 30, 40, up to 90, have been assigned to the specimens. 
This scale has been used very widely. Address Russell Sage Poun- 
dation, New York City. (Ref. 227.) 

Thig Bentence was used in securing specimens for the Freeman Scale. It 
contains all the letters of the alphabet. 

^These sentences were used in securing the specimens for the Thomdike 
Scale. 

"Walter S. Monroe, Eduoationai Tests and Measurements, p. 146. Honghton 
MiiBin Company, 1917. 
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2. Ay res' Scale for Measuring the QiuUity of Handwriting of 
Adults. This scale is similar to that described above, except that 
specimens of the handwriting of adults are used instead of the 
handwriting of school children. Address Bussell Sage Foundation, 
New York City. (Ref. 229.) 

3. Ayres' ** Gettysburg Edition.** This scale differs from the 
other two in certain important characteristics. It consists of speci- 
mens of school children's handwriting on ruled paper and there is 
only one specimen for each division or^e scale instead of three 
representing different degrees of slant. The copy, the first three 
sentences of Lincoln's Gettysburg Address ^ is the same for all spec- 
imens. The scale has printed on it standards for both speed and 
quality and complete directions for its use. Ayres asserts that the 
purpose of the new features is ''to increase the reliability of meas- 
urements of handwriting." Address Russell Sage Foundation, New 
York CSty. 

4. Breed and Downs* Scale. This scale was constructed in 
making a survey of the handwriting in the public schools of High- 
land Park, Michigan. The specimens were scored by means of the 
Thorndike Scale and then certain ones selected for a five-step scale 
for each of the following grades, 3d A, 3d B, 4th A, 5th A and 6th 
A. Thus, it differs from other scales in having a special scale for 
each of the grades named. (Bef. 234.) 

5. Courtis* Standard Research Tests, Handwriting, Series W. 
Test I, Handwriting, is an untimed "maximum performance" test, 
designed to secure samples of the children's best writing after prac- 
tice. Test II, Filing Test, is a "free-choice" copying test, designed 
to secure samples of the children's writing under working condi- 
tions. The test consists of the names and addresses of ten business 
firms, to be copied in alphabetical order. In both tests the quality 
of the writing is to be measured with the Ayres scale. The differ- 
ence in quality between the two samples reveals any "lack of trans- 
fer" from the work of the writing class to ordinary writing. The 
material in the Filing Test has been so chosen as to afford excellent 
material for an analysis of the defects in the writing of a particular 
child. Address S. A. Courtis, 82 Eliot Street, Detroit, Michigan. 
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6. Freeman's Handturiting Scale. This scale differs from the 
others in that there is one scale for each of the following character- 
istics of handwriting: (1) uniformity of slant, (2) xiniformily of 
alignment, (3) quality of line, (4) letter formation, and (5) spae- 

/ ing. Only three degrees of each characteristic 1, 3 and 5, are in- 
cluded in the scale, although the intermediate values, 2 and 4, may 
be used. This scale is designed for diagnosis rather than general 
measurement. Address Houghton Mifflin Company. (Bef. 240.) 

7. Or ay* 8 Score Card. This score card is of the same general 
character as those which are used in judging grain and livestock. 
It is based upon a determination of the important characteristics 
of handwriting. Its function is similar to that of the Freeman scale, 
t. e., to furnish a diagnosis rather than a general measurement. 
Address C. T. Oray, University of Texas, Austin, Texas. (Bef. 245.) 

8. Johnson and Stone's Scale. This scale is similar in gen- 
eral plan to the Ayres and Thomdike Scales, but based on several 
factors, including movement and a detailed analysis of legibility. 
Each specimen of the scale is accompanied by a legend which states 
its defects and merits in terms of the analysis appended, which in- 
cludes seven factors — letter formation, uniformity of slant, uni- 
formity of alignment, spacing, quality of line, size, and degree of 
slant. (Bef. 247.) 

9. TJiomdike's Scale. This scale was constructed on the basis 
of three characteristics — ^beauty, legibility, and general merit. The 
degree of these characteristics represented in the specimens of the 
scale was determined by the concensus of opinion of competent 
judges. The numerical values of the specimens of the Thomdike 
Scale range from 4 to 18, and one or more specimens are given for 
each degree of quality. Address Bureau of Publications, Teachers 
College, Columbia University, New York City. (Bef. 263.) 

10. Zaner and Blossom Handwriting Scales. These are a 
series of scales for the several grades, designed to be used with a 
particular system of handwriting. Address Zaner and Blossom 
Co., Columbus, Ohio. 
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Iowa Sehools* . . . 
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89.2 
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82 
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88 
85 
48.8 
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61.9 
47 
51 
51.2 

56 


60 

65.5 

57 

61 

69.1 

66 


70 

72.6 

65 

67 

62.8 

72 


76 
75 
76 
71 
67.9 

80 


80 

76.5 

76.5 

78 

78 
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25,887 
28.000 

4,740 

6.000 
84,000 
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of speeimens 
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Iowa Schools 

Starch's SUndard . 
Kansas Medians . . . 

Fifty-six cities 

Freeman's Standards 

(Ayres Scale) 
Salt Lake Oity^ . . . 



Bntte. Montana^* 



Sonthington, Oonn.^. 
OonnersTille, Ind.*^ . 



Freeman's Standards 
(Thomdike's scale) . . . 



85.7 

27 

44 

89.7 



8.2 



9.86 



89.8 
88 
47 
42 

47 
9.2 

8 



10.8 



9.75 



44.b 
87 
50 
46.8 

50 
10.7 

8.8 
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57 
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58.9 

64 
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11.2 

10 
11.7 
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56 
56 
67 
70 
62.8 

70 
12.8 

12.1 



11 



12.66 



Thorn- 
dike 

Thorn- 
dike 

Thorn- 
dike 

Thorn- 
dike 



25.287 

28.000 

4.740 

6.000 

84.000 



2.500 
1.400 
1.200 



VI. History 

1. Buckingham's Tests. These tests were used in the survey 
of the Gary and Prevocational Schools of New York City. They 
consist of two sets of questions which have been evaluated on the 
basis of the percent of correct answers. More recently Bucking- 

*Judd, Charles H., Measuring the Wbrk of the Public Schools. Bepi^ri, 
Survey Committee on the ClevelavSL Foundation^ 1916. 

^Ashbaugh, E. J., Handwriting of Iowa School Children. IZntv^ivity of 
Iowa, Extension THvieion, Bulletin No. 15, March 1916. 

*Starch, D., The Measurement of Efficiency in Beading, Writing, Spelling, 
and English. Univergity of WisoonHn, 1914. 

*DeVo8S, J C. Second Annual Beport of Bureau of Eduoa;tiondl Measure- 
menta and Standards. Kansas State Normal School, Emporia, Kansas. 

'•Freeman, P. N., Fourteenth Yearhook of this Society, Fart I, 1915. See 
also the Sixteenth Yearhook, Fart I, 1917, Ch. IV. 

^^Beport of a Survey of the SchooU of Saitt Lake City, Utah, (1915). 

"Beport of a Survey of the Sohooie of Butte, Montana, Ch. IV (1914). 

^'Witham, E. C, AU the Elements of Handwriting Measured. Eduoationdl 
Administration and Supervision, 1; 1915, pp. 313-24. 

'^Wilson, G. M., The Handwriting of School Children. Elementary School 
Teacher, 6; 1911, pp. 450-53. 
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7. The Trdbue CampUtum-Test Lanffuage Scales. Trabae 
has devised a series of Ck)mpletion-Te8t Langaage Scales for the 
general measurement of language ability. Each scale consists of 
sentences from which one or more words have been omitted. The 
position of the omitted words is indicated by a blank. The pnpil is 
to write in the misfling words. The relative difiSeolty of the sen- 
tences has been carefully determined, and they have been arranged 
in order of difficulty. It is claimed for these tests that a pupil's 
''language ability" is very closely related to his score on these 
scales. Copies may be obtained from the Bureau of Publications, 
Teachers College, Columbia University, New York City. (Bef. 202.) 

Stajtdabds: Teabum CoMPLinoir-TiflT Qcalmb 
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8. WiUing's Scale. Willing used compositions written by 
pupils in Orades four to eight on the topic "An Exciting Etzperi- 
ence." Several particular exciting experiences were suggested, and 
20 minutes was allowed for writing. In determining the compom- 
tions to be used for the scale, "all errors in spelling, punctuation, 
capitalization and grammar were counted and corrected." The 
compositions selected as samples for the scale were those which had 
the same rank in "story value'' and frequency of errors. Ad- 
dress Bureau of Measurements and Standards, Emporia, Kansas. 
(Be&. 504, 513.) 

For the Denver Survey the following median scores were ob- 
tained: 



Gnde | 4th A J 5th A J 6th A I 7thi 

Median | 81.5 f 48.4 | 50.9 | 60.8 



SthA 
68.4 



i 



9. Buckingham's Grammar Test. In making the surv^ of the 
Gary and the Prevocational Schools of New York City, Bucking- 
ham used a series of questions upon English grammar. These ques- 
tions were carefully evaluated upon the basis of difficulty. They 
have been re-arranged and published by Haggerty. (See bdow.) 
(Bef. 466.) 



BZI8TIN0 TESTS AND 8TANDABDS 



85 



Standards. Median Soobss vob Habvabd-Nswton Scals 



Grade 


Number of Oompoeition 


Median Soorea 


Vllb 


67 
72 
68 
61 
57 
61 


60 


vna 


64 


vnib 


66 


Villa 


69 


IXb 


68 


IX 


68 



4. HUlegas Scale for the Measurement of tJte Qiiality in Eng- 
lish Composition for Young People. This consists of ten composi- 
tions ranging from an artificial production, whose scale value is 
zero, to the tenth composition, whose scale value is 9.3. Three of 
the ten compositions are artificial productions, five were written by 
high-school pupils, and the remaining two by college freshmen. No 
two were written on the same topic and they vary greyly in length 
and type. Each degree of merit is represented by only one com- 
position. (Ref. 172.) 

Standards tob thb Hillboas Soaui 



Orade 


SaKLake 
Oity 


Butte 


Trabue : 

Median 

Score 


Trabue: Score above 

whicb three-fourths of 

pupils should rank 


IV 


2.9 
8.1 
8.8 

4.4 
5.4 

M • • 

• • • 

• • • 
• • • • 


2.84 
2.87 
8.40 
8.76 
4.11 
.... 
• . • • 

■ • . 


8.5 
4.0 
5.0 
5.0 
5.5 
6.0 
6.5 
6.0 
7.8 


8.0 


V 


8.6 


VI 


4.0 


vn 


4.6 


VIII 


6.0 


IX 


5.6 


X 


6.0 


XI 


6.4 


XII 


6.7 



5. Nassau County Supplement. The Nassau County Supple- 
ment to the Hillegas Scale consists of nine compositions, seven of 
which were written by elementary-school pupils on the topic '*What 
I should like to do next Saturday." The compositions of the scale 
were carefully selected and evaluated by an elaborate method which 
cannot be even sketched here. Copies may be obtained from the 
Bureau of Publications, Teachers College, Columbia University, 
New York City. (Ref. 203.) 

6. Thomdike's Extension of the Hillegas Scale. This exten- 
sion is similar to the original scale, except that a larger number of 
compositions have been used, thereby making a more finely divided 
scale as well as providing several compositions for each degree of 
merit in the middle of the scale. Address Bureau of Publications, 
Teachers College, Columbia University, New York City. 
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7, The Trahue Completion-Test Language Scales. Trabne 
has devifled a series of Completioii-Test Langaage Scales for the 
general measurement of language ability. Each scale consists of 
sentences from which one or more words have been omitted. The 
position of the omitted words is indicated by a blank. The pupil is 
to write in the missing words. The relative difiSculty of the sen- 
tences has been carefully determined, and they have been arranged 
in order of difficulty. It is claimed for these tests that a pupil's 
'language ability" is very closely related to his score qxl these 
scales. Copies may be obtained from the Bureau of PublicationB, 
Teachers College, Oolumbia University, New York City. (Bef. 202.) 

Stakdabds: TmhBum Oomplbtioh-Tist Soalsb 
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8. Willing' 8 Scale. Willing used compositions written by 
pupils in Orades four to eight on the topic "An Exciting Experi- 
ence. ' ' Several particular exciting; experiences were suggested, and 
20 minutes was allowed for writing. In determining the composi- 
tions to be used for the scale, "all errors in spelling, punctuation, 
capitalization and grammar were counted and corrected." The 
compositions selected as samples for the scale were those which had 
the same rank in "story value" and frequency of errors. Ad- 
dress Bureau of Measurements and Standards, Emporia, Kansas. 
(Befs. 504, 513.) 

For the Denver Survey the following median scores were ob- 
tained: 



Grade | 4th A | 5th A I 6th A I 7th A 

Median | 81.5 | 48.4 [ 60^9 | 60.8 



8fhA 
68.4 



9. BuckingJiam's Grammar Test. In making the surv^ of the 
Gary and the Prevocational Schools of New York City, Buddng- 
ham used a series of questions upon English grammar. These ques- 
tions were carefully evaluated upon the basis of difficulty*. Thqr 
have been re-arranged and published by Haggerty. (See below.) 
(Bef. 466.) 
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10. Charters' Cframmar Test. This test consists of sentences 
containing an incorrect form. The pupil is to write the sentence in 
the correct form and give the grammatical reason for doing so. The 
incorrect grammatical forms were selected from the errors occur- 
ring in the oral and written speech of pupils. Address W. W. Char- 
ters, University of Illinois, Urbana, Illinois. 

11. Haggerty's Cframmar Test. Same as Buckingham's, with 
the questions re-arranged and printed in convenient form. Ad- 
dress Bureau of Cooperative Besearch, University of Minnesota, 
Minneapolis, Minnesota. 

12. National Business Ability Tests. These include two tests 
on grammatical form and one on punctuation. In the grammar 
tests the pupil is to choose between two forms which are given. Ad- 
dress Sherwin Cody, Managing Director, 189 West Madison St, 
Chicago, Illinois. 

^ 13. Starch's OrammaticdL Scales. Starch has devised three 
scales (A, B, and C) to measure a pupil's ability to use correctly 
certain language forms. His Grammatical Scale A consists of a 
series of exercises arranged in order of increasing difficulty. As 
tentative standards of attainment Starch gives the following scores 
for the use of these scales (Bef. 214) : 



Grade 

Seore 


vn 

8.0 


VIII 
8.8 


IX 
8.6 


X 

8.9 


XI 
9.2 


XII 
9.6 


10.8 



14. Starch's Puncttiation Scale. Starch has also devised a 
Punctuation Scale which is similar in form to the Orammatical 
Scales. The exercises consist of sentences to be punctuated. The 
following are tentative standard scores of attainment for the ends 
of the respective school years : 



1 


Oradee | 


High School 


1 


Uniyenlty 


Year 


7 8 1 
8.0 8.8 8.6 


2 8 
8.9 9.2 


9.5 1 


8 


Score 


10.8 







*^ 15. Starch's Orammatical Tests. Starch has also devised three 
tests for measuring directly a pupil's ability to recognize certain 
language forms. In Test 1 the pupil is asked to mark the part of 
speech of each word in a certain printed text. His score is the num- 
ber he designates correctly in three minutes. Test 2 calls for the 
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designation of the case of the nouns in another printed test. Test 3 
has to do with the tense and mode of verbs. 
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High School 1 


UaiTonity 


Ymr 


7 8 
80 88 
18 16 
18 16 


12 8 4 
86 40 48 46 
20 28 26 80 
20 28 26 80 
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Seorcp Test 1 

Seore, Test 2 

Seore, Test 8 


60 
45 
45 



Address Daniel Starch, University of Wisconsin, Madison, 
Wisconsin. 

16, Thompson's Research Test in Grammar. This is a test 
of the pupil's ability to indicate the part of speech in a list of words. 
The feature of the test is a mechanical device for scoring the papers. 
Address T. E. Thompson, Monrovia, Calif omia. 

17. Boston Copying Test. This test was devised to measure 
the ability of pupils to copy printed matter. In giving the test, 
each pupil was provided with a printed selection which he was asked 
to copy with pen and ink. In marking the papers the following er- 
rors were noted : in spelling, capitalization, punctuation, undotted 
i's, uncrossed t's; in omitting words, in adding words, in wrong 
words used, and in misplaced words. (Bef. 164.) 

The errors noted consisted of nine different kinds, and the num- 
ber of each kind made in this test by 4494 pupils is shown by the 
f dlowing tabulation :— 

Spelling 5,829 

Capitalization 644 

Omitted words 4,077 

Added words 606 

Wrong words used 840 

Misplaced words 105 

Punctuation 5,876 

Undotted i's 8,794 

Uncrossed t's 606 

Total 27,377 

Average errors per pupil 5.54 
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VIII. Music 

1. Seashore's Musical Talent Chart. This chart is based upon 
the analysis of musical ability and offers a graphic means of rep- ^' 
resenting the pupil's musical ability. Address Carl E. Seashore, 
University of Iowa, Iowa City, Iowa. 

IX. Silent Beading 

1. Brown's Silent Reading Test. This test consists of a very 
interesting reading selection, which is used in Grades III to VIII. 
Duplicate selections of equivalent difSculty are obtainable. The 
directions require that the children read the selection silently for 
exactly one minute, then draw a line around the word which they 
have reached when the examiner calls **Stop.'' The number of 
words read makes the score in speed. 

The children are then asked to write as much as they can re- 
member of what they have read. A key is provided for the exam- 
iner to use in scoring the papers. On it are listed all the separate 
ideas contained in the selection. By comparing the child's papers 
with the key, the examiner determines how many different points 
there are in what the child read. Then his reproduction is exam- 
ined carefully to determine (1) quantity and (2) quality of com- 
prehension. Address, Bureau of Research, 25 Capitol St., Concord, 
New Hampshire. (Befi9. 286, 287, 288.) 

Standards: Tiktatiti Scobss With ths Brown Silsnt Bbading Tbst 
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Grade III 
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Grade VI 
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8.82 
8.55 
4.40 
4.54 
4.65 
4.84 


46 
65 
61 
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78 
79 


127.8 
217.1 
291.0 
295.0 
822.8 


Grade Vni 


828.6 



2. Courtis Standard Research Tests in English. These are a 
series of tests devised by Courtis to measure speed and comprehen- 
sion of silent reading. The series of tests was so complex that the 
marking of the test papers was a laborious task. For this reason 
the publication of the tests has been discontinued. (Bef. 291.) 

3. Courtis Research Tests Silent Reading (Series R, Test 2). 
This test is suitable for Grades I to VI. It measures a phase of read- 
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ing ability acquired in Grades II, III, and IV. In the first part of the 
test the children read a simple child's story under normal condi- 
tions. From this work a measure of the rate of reading is derived 
In the second part of the test the paragraphs of the story are re- 
printed and under each are given five simple questions about the 
paragraphs. The questions may be answered by '*yes" or **no" 
and they are designed to measure a child's comprehension of the 
relation existing between the essential elements of the story. The 
tests are available in two forms of nearly equal difficulty, so that 
measurements may be made at the beginning and end of the year. 
Address S. A. Courtis, 82 Eliot Street, Detroit, Michigan. (Bef. 
293.) 

OovBTis SiLsvT RBADnra: Sbbibs B. Tin 2 
(Median Grade Seorei at the end of the Year) 

Grade II III IV V VI 

Scoree 84 118 145 les 191 

4, Fordyce's Scale for Measuring the Achievements in Read- 
ing. This scale consists of a selection to be read, upon which the 
pupils are required to answer certain questions that have been 
weighted for determining the comprehension score. The sx)eed of 
reading is found by having the pupils mark the word they have 
reached at the end of the stated interval. In order that all may 
have the information necessary for answering the questions^ the 
pupils are then directed to finish the story. Address the Univer- 
sity Publishing Co., Lincoln, Nebraska. 

STAKDABDS in PnOBKTS: FOBDTOB SlIiBNT RSADINa Tbst 

Teat No. 1, designed for Gradea III, IV and V. ~ 

Grade Ill IV V 

Speed 90 95 100 

Qnality 57 71 74 

Teat No. 2, designed for Grades VI, VII and VHI. 

Grade VI VH VXU 

Speed 90 100 100 

Qnality 41 45 60 

5. Gray's Silent Reading Tests, These tests consist of three 
selections, one for Grades II and III, one for Grades IV, V, and VI, 
and another for Grades VII and VTII. The selections are so ar- 
ranged on the pages that the time required to read one hundred 
words can be readily ascertained. Only one child is tested at a time. 
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After completing the reading, the child, if in the second or third 
grade, tells the story to the examiner, who writes it down. In the 
grades above the third, the child writes all he can remember of the 
story, and then writes answers to a set of questions which is fur- 
nished him by the examiner. The child's score for quality of read- 
ing is assigned on the basis of two factors, reproduction and ac- 
curacy. Reproduction is determined by the number of words which 
remain in the child's composition, after all wrong or irrelevant 
statements and repetitions are stricken out. Accuracy is deter- 
mined on the basis of ten points for each correct answer. The 
quality mark is the average of these two. Address William S. Gray, 
School of Education, University of Chicago, Chicago, Illinois. 
(Befs. 297, 300a.) 
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Rate (worda per aeoond) 
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1.50 2.80 
82 87 


2.20 2.57 2.79 
29 82 89 


2.69 
22 


2.87 
27 



6. Haggerty's Visual Vocabidary Tests. The tests prepared 
by Haggerty, of the Bureau of Cooperative Research, School of 
Education, University of Minnesota, are but a slight modification 
of the Thomdike Visual Vocabulary Scales, with the addition of 
an oral test for children of Grades I and n. This test will be de- 
scribed under the heading of ''Oral Beading." Scale B2, of which 
there is one sheet for children of Grades III and IV and another 
sheet containing part of the same words and additional more diffi- 
cult words for Grades V, VI, VTI and VIII, is devised in exactly 
the same way as the Thomdike scales. Methods of scoring are 
somewhat more simple, and the lists are briefer than those used by 
Thomdike. Forms of equivalent difficulty are obtainable. Ad- 
dress Bureau of Cooperative Research, University of Minnesota, 
Minneapolis, Minnesota. (Ref. 301.) 

7. Kansas Silent Reading Tests. These tests were devised by 
F. J. Kelly. Both speed and comprehension of reading are com- 
bined in a single mark. These tests coneost of graded lists of exer- 
cises which have been carefully evaluated. Each exercise consists 
of the directions for doing something, which is very simple after 
the pupil has fully understood the directions. His comprehensiaii 
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of the exercise is measured by what he does. Test I is for Grades 
III, IV, and V ; Test 11 for Grades VI, VII and VIII ; Test HI for 
Grades IX, X, XI, and XII. Address Bureau of Educational 
Measurements and Standards, Emporia, Kansas. (Befs. 314, 315.) 

Standards : Msdian Scobbs, Kansas Silbnt RBADura Tbbtb 
(Based upon more than 100,000 Scores) 
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17.9 
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18.9 
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22.9 


25.6 
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8.2 


18.0 


17.5 


19.8 


21.9 


20.4 


80.4 


81.9 


88.1 


84.1 



8. The Minnesota Scale Beta. This is slightly modified form 
of Thomdike's Scale Alpha {q. v.) It is printed in a form which 
is more convenient for use. This scale is issued in two forms which 
are approximately equal in value. Address Bureau of Cooperative 
Research, University of Minnesota, Minneapolis, Minnesota. 

9. Monroe's Standardized Tests in Silent Reading. In these 
tests those features of the Kansas Silent Beading Tests which have 
proved satisfactory have been incorporated. The exercises have 
been secured from school readers and other books which children 
read. Test I is for Grades III, IV and V ; Test II for Grades VI, 
VII, VIII ; Test III for Grades IX, X, XI, and iXII. These tests 
are issued in three forms which are equivalent in value. Address 
Bureau of Educational Measurements and Standards, Emporia, 
Kansas. 

10. Starch's Silent Reading Tests. These tests are similar to 
Brown's Silent Reading Tests described above, except that differ- 
ent selections are used for the different grades. Address Daniel 
Starch, University of Wisconsin, Madison, Wisconsin. 



Standabds: VLxDiATX ScoBKS IN Staboh Silent Rbadinq Tbbts 
(Attained at the Close of the Respective Years) 




Grade or Years | I H ni|iv|v|vi|vil| VTII 


Speed (words per second) . . . 
Comprehension 

(words written) 


1.5 
15 


1.8 
20 


2.1 
24 


2.4 
28 


2.8 
88 


8.2 
88 


8.6 
45 


4.0 
50 



11. starch's English Vocabulary Tests. These tests are lists 
of one hundred words, each selected at random from a dictionary. 
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The child is asked to check the words, the meaning of which he is 
certain, and to write the meaning after the words of which he is 
in doubt. The score is the percent of words thus checked or cor- 
rectly defined. These tests measure the extent of the pupil's vocab- 
ulary, regardless of the value of the words. Address Daniel Starch, 
University of Wisconsin, Madison, Wis. 

The following are tentative standard scores for the various 
years as determined from tests made in four schools (Bef. 333) : 







Elementary 


High School 


UniTenity 


Tears 


4 


5 6 7 8 
88 86 89 42 


12 8 4 
46 47.2 50 58 


12 8 4 


Scoree 


80 


56 58.5 61 68 



12. TJiomdike's Visiuil Vocabulary Scales, Thomdike is the 
author of three visual vocabulary scales: Scale A, Scale A2 and 
Scale B. The latter two represent extensions of the former, and 
were derived by the same method. Scale A2 and Scale B are in- 
tended for use alternately or interchangeably, and each is issued in 
three forms. Each scale consists of graded lists of words, the mean- 
ing of which the pupil is to indicate by assigning the words to 
certain classes. Address Bureau of Publications, Teachers Col- 
lege, Columbia University, New York City. 

Standards : No standards have as yet been derived by the use 
of the Thomdike Scale A2 or Scale B with large numbers of public 
school children. In the following table the standards of achieve- 
ment by the use of the Thorndike Scale A (with which the values 
on Scales A2 and B are supposed to be identical) are given, and 
serve as tentative standards for purposes of comparison. The score 
values were obtained by the measurement of the pupils in 18 cities 
in Indiana. (Befs. 336, 342.) 

MSDIAN SOORKS IN VISUAL VOOABTLABT BT THl ThOBNDIKI SOALl A 





in 


rv 


V 


VI 


1 vn 




Grades 


vni 


Median Score 

Number of Children 


4.00 
1650 


5.26 
2095 


6.00 
2028 


6.66 
1860 


7.29 
1625 


7.91 
1818 



13. TTiorndike's Scale Alpha and Alpha 2 for Measuring the 
Understanding of Sentences. Scale Alpha 2 is a slightly more elabo- 
rate edition of Alpha. Each scale consists of a carefully graded 
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mrim ot paragraphs. Each paragraph ia foIlowBd hf 
ti/ma which the child ia to answer aa he reads Ike 
pupil's answers to the questions determine the 
prehimsion. In the Teachers CoUege Record 
^lerivatifm of this scale, there is given a score card 
answers to these questions. Address Bureau of 
Teachers College, Columbia Universityy New Yorik 
340, 343.) 

The following table gives the median sooreB for tlie 
18 cities in Indiana, as reported by EUtggerty. 

Mm/M« Htftmun iw UvniftrrAWMifO ov Sihtivobs bt thb Tai 




i$f%Atm .| Til I IV I V I VI I 



lf«4Ufi I 0.48 I 6.50 

finmhm itf pttplUi I 1650 | 2095 



7.66 
2028 



8.46 S.TS ' 

1860 lass I ISU 



X. Oral Beading 

/. Oray'n Oral Reading Test. This test consists of twdve 
griipliN, arrniigffd in order of increasing difficulty. The relative dif- 
flciiliiirs hiivo b(!cri establishod experimentally. The child'a oral 
reading of each parugra])h is checked for time, and for each of six 
iyium (it orrom: groHs errors, minor errors, omissions, sabstitatiims; 
insiirtionM, and n*[)ctiti()nH. Address William S. Gray, School of 
Kducaiion, Univcniity of Chicago, Chicago, Illinois. (Bef. 297.) 

;^. lluffffiirty'H Visual Vocabulary Tests. For Grades I and 11 
th(*Ni) conMlNi of two sheets, one of eight words and the other of 
phonetic words Kclccted from the Jones test. The words on. idther 
sheet are groupe^l into lists according to difficulty. Thia difficulty 
wfiN df)1^Tinined by trial with several hundred primary children. A 
value is atiiK^hcd to ciich word according to its ascertained difficulty. 
The nhil^i \h nnkv-d to pronounce the words aloud; his score is the 
value attached to the most difficult list of which he can pronounce 
four out of five words correctly. Two equivalent forms are avail- 
tihU\ AddrcNH Burwiu of (Cooperative Research, University of 
Minnesota, MinTieapolis, Minnesota. (Ref. 301.) 

.7. Jones' Visual Vocabulary Tests. Selecting ten of the most 
widely used primcrH, JoncH found the frequency of occurrence in 
all the primers of each word occurring in any of them. He tiaed 
this frequency as a measure of the value of each word. Using the 
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values thuB determined for each word, lists of words were made up 
as tests. The score is the sum of the values attached to the words 
which the pupil can pronounce correctly. Address R. G. Jones, 
Qeveland, Ohio. (Bef. 308.) 

4. Price's Oral Beading Tests. These consist of a series of 
suitable oral reading exercises for Orades II to VHI, inclusive. Two 
forms are available for each grade. Pupils are scored for words 
mispronounced, words inserted, words omitted, words transposed 
and number of words read. Address Supt. E. D. Price, Enid, 
Oklahoma. 

XI. Spelling 

1. Ay res' Spelling Scale. This scale consists of a list of the 
one thousand most frequently used words of the English language. 
These were determined by means of careful analysis of written 
material, ranging from friendship letters to some of our best prose. 
Later the words were classified according to frequency of mis- 
spelling for each of the several grades, and the percent of correct 
spellings for each grade was printed at the head of each list. These 
standards are for the words when used in dictated lists and without 
regard to whether the words have been taught in the respective 
grades or not. 

Strictly speaking, Ayres' Spelling Scale is not a scale or test, 
but a list of words from which tests can be made to measure the 
ability of pupils to spell the foundation words of the English lan- 
guage. The next four tests were constructed by using words from 
Ayres' list. Address Russell Sage Foundation, New York City. 
(Ref.352.) 

2. Courtis Standard Research Tests in Spelling. In these 
tests words chosen from suitable columns of Ayres' Scale are em- 
bedded in sentences, and the sentences are arranged so that they 
can be dictated at specified rates, which correspond to the rate of 
writing in the several grades. Each test includes 20 words. The 
standards set by Courtis are slighfly lower than Ayres' Standards 
for the same words when dictated as isolated words. Address 
S. A. Courtis, 82 Eliot St., Detroit, Michigan. 

3. The Iowa Dictation Exercise and Spelling Tests. These 
tests, prepared by E. J. Ashbaugh, of the Extension Division, Uni- 
versity of Iowa, confidst of twenty words embedded in sentences and 
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an equal number to be dictated separately. Each of the senteneee 
has been constructed so that it is to be written in 30 seconds. Test I 
is for Grades III and IV, Test II is for Grades V and VI and 
Test III is for Grades VII and VIII. Address E. J. Ashbao^ 
Iowa City, Iowa. 

4. The Nebraska Spelling Test. This test, prepared by Dean 
Cyhas. Fordyce, of the University of Nebraska, consists of twenty 
words embedded in sentences which are to be dictated at rates speci- 
fied for the several grades. The same words are used for all grades. 
Addn^HH Dean Chas. Fordyce, Lincoln, Nebraska. 

5. Monroe's Timed Sentence Spelling Tests. These tests dif- 
fer from the foregoing in that 50 words are used and no test words 
occur at the end of a sentence. This last feature protects the slow 
writer. Test I is for Grades III and IV, TestI II is for Grades V 
and VI and Test III is for Grades VII and VIII and for the high 
school. The normal rate of writing was determined by measuring 
the speed of 6,000 Kansas school children. Address Bureau of 
Kducutioiinl Measurements and Standards, Emporia, Kansas. 

6. Boston Minimum Spelling Lists. These consist of a list 
(for each grade) of ** commonly used but often misspelled words." 
Those words have been standardized for the grades in which they 
are to be taught, and hence constitute lists from which words for 
testing may be selected. Address Department of Educational In- 
vestigation and Measurement, Boston, Mass. (Ref. 355.) 

7. Buckingham's Spelling Scale. Starting with a list of 
about 5,000 words common to at least two out of five spelling books, 
Buckingham by means of an elaborate statistical procedure, selected 
two lists of 25 words each. The purpose of the selection was to 
secure ** words which were easy enough in the third grade and hard 
enough in the eighth grade to afford a test in those and therefore 
intermediate grades, and which showed regular increases in percent 
correct from grade to grade. ' ' The difiiculty of each word was de- 
termined in terms of a common unit. Since the difficulty of each 
word is known, the entire list, or any desired portion of it, may be 
used as a test. Address Bureau of Publications, Teachers College^ 
Columbia, University, New York City. (Ref. 358.) 
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6. Jones' Concrete Investigation of the Material of English 
Spelling. This bulletin presents the results of an investigation to 
determine ''what words, 'grade for grade/ do children use in their 
own free written speech, and which, therefore, they need to know 
how to spelL " This list has been used as the basis for the construc- 
tion of tests. One such test has been devised by W. W. Phelan, 
University of Oklahoma, Norman, Okla., and used extensively in 
that state. For the BvUetin, address University of South Dakota, 
Aberdeen, South Dakota. ( Bef . 370. ) 

P. National Business Ability Tests. The elementary test con- 
sists of 50 words chosen from Ayres' ^st of 542 obtained from the 
examination of two thousand letters. The advanced spelling test 
consists of a list of 50 words which are printed incorrectly. In 
ten minutes the pupil is to write the words correctly. Address 
Sherwin Cody, 189 West Madison St, Chicago, Illinois. 

10. Rice's Spelling Test. This test has a very great historical 
importance because it was Bice's report on spelling at the meeting 
of the Department of Superintendence in 1897 that marks the begin- 
ning of the modem movement for scientific measurement in edu- 
cation. (Ref. 378.) 

11. Starch's Spelling Scales. These scales have a function 
which differs from that of Ayres' Scale or a test made from Ayres' 
list The latter measures how well pupils can spell the most com- 
monly used words of the English language, while Starch's test 
measures the size of one's spelling vocabulary. The tests consist 
of words selected at random from the non-technical words of the 
English language, with no regard to the frequency with which they 
are used. Address Daniel Starch, University of Wisconsin, Mad- 
ison, Wisconsin. 

Standards : Starch gives the following standards for his tests 
based on their use with over 2,500 pupils. 



Grade I |n|in|iv|v|vi|vn 


Vlll 


Pcnent of words 
■pellad oorreotly 


10 


80 


40 


61 


61 


71 1 78 


86 



These standards are interpreted thus : the average eighth-grade 
pupil should be able to spell correctiy 85 percent of the non-tech- 
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nical words of the English language, or 85 of the 100 words in any 
one of Starch's tests. (Ref. 384.) 

Tests for Use in the High Schooij 

Certain tests of those described in the preceding pages are in- 
tended to be used in the high school, as well as in the elementary 
school. These are Test III of the Kansas Silent Beading Tests, the 
Thomdike Scale Alpha for Measuring the Understanding of Sen- 
tences, Starch's English Vocabulary Test, certain composition 
scales, the copying test, the Trabue Completion-Test Language 
Scales, and Starch's Grammatical Tests. For the description of 
these tests and the use of them, the reader is referred to the pre- 
ceding pages. 

In addition to these tests, many of the others have been applied 
to high-school pupils. For example, the Courtis Standard Research 
Tests in Arithmetic, Series B, have frequently been given to high- 
school pupils, although many of them were not studying arithmetic 
However, in applying such tests to high-school pupils it should be 
remembered that the testa were not designed for that purpose, and 
it may be expected that they will not be as satisfactory as when used 
in the way intended. 

I. Algebra 

1. Coleman's Scale for Testing Ability in Algebra. This test 
consists of a series of exercises arranged in order of difficulty. Ad- 
dress Supt. W. H. Coleman, Bertrand, Nebraska. 

2. Hotze's First-Year Algebra Scales. These scales include 
tests on the following topics: (1) addition and subtraction, (2) 
multiplication and division, (3) equations and formulas, (4) ^aphs, 
(5) problems. They were restricted to these topics because the 
author felt *'that the main business of the work in first-year algebra 
was to teach students how to solve typical algebra problems through 
the use of algebraic symbols." Address Bureau of Publications, 
Teachers College, Columbia University, New York City. 

3. IndiancD, Algebra Tests. Monroe's Standard Research 
Tests in Algebra, described below, were incorporated in this series. 
The other six tests of the series were devised by H. G. Childs, of the 
University of Indiana. (Ref. 58.) 
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4. Monroe's Standard Research Tests in Algebra. These con- 
sist of a series of six tests. Each of the first five tests is designed 
to measure the ability to do one of the operations occnrting in the 
solution of simple equations. Address Bureau of Educational 
Measurements and Standards, Kansas State Normal School, Em- 
poria, Kansas. (Refs. 60, 61.) 
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5. Stromquist's Preliminary Algebra Tests. This series of 
tests includes tests upon the following operations: (1) addition, 
(2) subtraction, (3) multiplication, (4) division and (5) factoring. 
Address, University of Wyoming, Laramie, Wyoming. 

6. Rugg and Clark Standardized Tests in First-Year Algebra. 
This aeries includes sixteen tests which are intended to measure all 
of the types of exercises in the work of the first year. Address H. 
0. Bugg, University of Chicago, Chicago, 111. (Kef. 66.) 

TENTATITB BTANDABDS FOB BUGO A OLABK PIBST-YBAB ALOBBBA TBST8 
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et&ndards for Teats 1, 3, 4, 9 and 16 will be sent to cooperating Khools 
during 1917. 

Score for Test 15 is minutM required to solve tne problem. 
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7. TJiomdike's Algebra Test. This is a series of eight exer- 
cises arranged in order of increasing difficulty as determined by the 
opinion of competent judges. 

II. Drawing 

1, Rugg's Scale for Measuring Freehand Lettering for Use in 
Secondary Schools and Colleges. It consists of a series of 8 samples 
of freehand lettering, arranged in the order of increasing merit 
It may be used in measuring the efficiency of a student's work in 
freehand lettering. Address H. 0. Bugg, School of Education, 
University of Chicago, Chicago, 111. (Ref. 156.) 

III. Foreign Language 

1. Brown* s Connected-Latin Test. This test consists of a con- 
nected passage of Latin, to be interpreted in terms of its thou^t 
content. The pupils are given a specified amount of time in which 
to interpret and write in English as much of the passage as pos- 
sible. The translation is scored by means of a key. 

2. Brown* s Latin^Sentence Test. This consists of a series of 
Latin sentences ranging from very easy to very difficult. The sen- 
tences are graded and evaluated, and each is assigned a scale value. 

3. Brown's Formal Latin-Vocabulary Test. A list of fifty 
isolated words which have been graded and evaluated and a scale 
value assigned to each. The pupils are scored on their ability to 
give correct meanings for the words. 

4. Brown's Functional Latinr-Vocabulary Test. A list of 
words in the Latin-Sentence Test. The pupils are scored on their 
ability to re-act to these words correctly in their functional rela- 
tionships in sentences. 

5. Brown's Formal Latin^Grammar Test. This test is made 
up of twenty constructions in Latin sentences. The constructions 
are in italics and the pupils are required to name and describe th^n, 
but not to translate the sentences. 

6. Brown's Functional Latin^Grammar Test. A series of 
Latin constructions chosen from the Latin-Sentence Test. The 
pupils are graded on their ability to react correctly to these con- 
structions in their normal settings. 
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With the foregoing six tests a survey was made of the work in 
Latin in New Hampshire secondary schools. The high schools of 
every city and every large town in the state were tested. Most of 
the private academies and seminaries were also reached. The re- 
sults are to be set forth in a document entitled A Study of AbUity 
in Latin. This will consist of about 300 pages when printed and 
will be published by the Bureau of Educational Research of the New 
Hampshire Department of Public Instruction, Concord. For fur- 
ther information address President H. A. Brown, State Normal 
School, Oshkosh, Wisconsin. (Ref. 277.) 

7. Hanus* Latin Tests. These consist of four tests for vocab- 
ulary, a translation test, and a granmiar test All of these tests 
are based on Caesar and Cicero. No words appear in the vocabu- 
lary tests ''which occur less than one hundred times in Caesar and 
Cicero." The translation test "contains only constructions which 
are found at least five hundred times in Caesar and Cicero." The 
grammar test is based on the sentences to be translated. Address 
Paul Hanus, Harvard University, Cambridge, Massachusetts. (Bef. 
278.) 

8. Henmon's Latin Tests. These consist of (1) an easy hun- 
dred-word vocabulary test — 50 in English and 50 in Latin — con- 
taining the words that are common to four widely used first-year 
books, (2) a standard vocabulary test of 239 words representing all 
the words common to 13 first-year books and to Caesar, Cicero, and 
Virgil, (3) a Latin-sentence test consisting of 30 sentences con- 
structed by using none but the 239 words of the Standard Vocabu- 
lary Test. Address V. A. C. Hennon, University of Wisconsin, 
Madison, Wis. 

9. Starch's French Vocabulary and Reading Tests. The vo- 
cabulary test consists of 100 French words selected at random from 
a French dictionary. The English equivalents of these words are 
given on the test sheet, and the pupil is tested by means of the num- 
ber of English equivalents he can correctiy associate with the 
French words. The reading test consists of simple sentences to 
be translated. 

10. Starch's German Vocabulary and Reading Tests. These 
are similar to the tests for French. Copies of these tests may be ob- 
tained from Daniel Starch, University of Wisconsin, Madison, Wis- 
consin. 
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11. Whipple's Oerman Vocabulary Test This is a Yocabo- 
lary test to measure the ability of graduate students to read selen- 
tific Gterman in the field of educational psych(dog7. A score of 60 
has seemed to indicate sufiScient ability to read psychology and edu- 
cation in (German. Address Guy M. Whipple, University of Illi- 
nois, Urbana, Illinois. 

IV. Geometry 

1. Minnick's Oeometry Tests. This series of tests is baaed on 
the assumption that the demonstration of a geometrical theorem 
involves the following abilities: (1) the ability to draw the figure, 
(2) the ability to state the hypothesis and conclusion, (3) the ability 
to recall facts concerning the figure, (4) the ability to select and 
organize facts so as to produce the proof. Address J. H. Minnick, 
University of Pennsylvania, Philadelphia, Pennsylvania. 

2. Rogers' Mathematical Tests. These are a series of testi 
designed to measure several types of reasoning ability in the field 
of mathematics. The series includes tests on arithmetic and alge- 
bra as well as geometry. Address Bureau of Publications, Teachers 
College, Columbia University, New York City. 

3. Stockard and BelVs Geometry Test. This test consists of 
70 questions arranged in 20 groups. '^ These groups involve draw- 
ing figures, naming figures, indicating order of development in dem- 
onstration, completing statements, stating of converse, definitions, 
regular polygons, parts of a demonstration, angular relations, area 
of trapezoid, angles in polygons, angles in circles, congmency of 
triangles, similarity of triangles, loci, auxiliary lines, simple con- 
structions, ratio and proportion, algebraic expression of geometrical 
relations, and equivalent construction. The questions are asked in 
such a way that many pupils are able to complete the list in forty 
minutes." (Ref. 223.) 

V. History 

1. Sackett's Scale in Ancient History. This scale consists 
of a series of eight tests, or exercises, the questions of which call for 
the essential information in the field of ancient history. The items 
of this information were determined upon the basis of a careful 
examination of an American history text and the judgment of 
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experts in the field. Address L. W. Sackett, University of Texas, 
Austin, Texas. (Ref. 273.) 

VI. Physical Training 

1. Rapeer^s Scale for Measuring Physicdl Education. This 
is a score card for judging five aspects of the results of physical 
education, i.e., health, physiological efficiency, physical develop- 
ment, physical ability and mental qualities. Address L. W. Bapeer, 
San Juan, Porto Rico. 

VII. Physics 

1. Starches Tests in Physics. The tests consist of 75 sentences 
from which certain words have been omitted. The sentences and 
the words to be omitted have been so chosen that a pupil cannot 
supply the correct words unless he knows certain physical facts or 
principles. The facts, principles, and laws upon which these sen- 
tences are based were determined by examining five widely used 
textbooks. The 102 facts, principles, or laws which were treated by 
all five of the books are the ones which the pupils must know to do 
the tests correctly. Address Daniel Starch, University of Wiscon- 
sin, Madison, Wisconsin. 

DiSTRmunNQ Centers 

Information in regard to particular tests can always be ob- 
tained by writing directly to the authors. Very many of the tests 
and scales, however, can also be secured from various distributing 
centers, principally University Bureaus of Cooperative BesearclL 
For the convenience of those interested, the addresses of the six 
most important distributing agencies are given below : 

1. Bureau of Publications, Teachers College, Columbia Uni- 

versity, New York City. 
Tests by Thomdike, Stone, Hillegas, Trabue, Woody, 
Bonser and many others. 

2. Russell Sage Foundation, Division of Education, New 

York City. 
Ayres Writing and Spelling Scales. 
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Btady of the marks given pupils by teachers. Two growing tenden- 
cies are worthy of mention ; first, saperintendents are recording and 
studying the marks receiTcd by a class in order to discorer ^diat 
percentage of the pupils receive superior, satisfactory and poor 
ratings, and they are rating teachers, and making adjustments of 
work, on the basis of comparative percentages of failure; second, 
they are accumulating such data from year to year and subjecting 
them to careful statistical and graphical analysis. That ia, sehool 
men are no longer content to hope and believe that tb^ work is 
going well; they are attempting systonatically to secure exact 
knowledge of the effects of their efforts by a scientific study of aU 
available data. 

Rating the Teacher *s Efficiency, Immediately related to the 
measurement of the work of the pupils is the estimate of the teach- 
er 's ability. The tendency appears to get away from general com- 
ment and to record specific details about the recitation itself. A 
rating card of the general type contains such questions as : 

Does the teacher show skiU in habit formation? 
Does the teacher show skill in stimulating thought t 
Is the subject matter organized t 

Are proper habits of action developed both in and out of the 
classroom t 

Is the teacher interested in the life of the community t 

A rating card which goes into particulars contains such ques- 
tions as : 

Number of minutes lost in calling the class t 
Number of minutes lost in distributing material t 
Extent to which the recitation was confined to the textt Be- 
lated to the pupils' lives and experiences t 

Number of questions which caused the pupils to think before 
answering? Number requiring merely yes-or-no answers? 

Another tendency of teacher rating takes the form of self-exam- 
ination, of which the following is an illustration : 
Clearing up pupils' difiSculties. 

1. What plan or method have I for discovering the difficulties 
which the class as a whole may have, and specific difficulties which 
individuals may have t For providing the particular help a pupil 
needs to clear up his own difficulty t 



CHAPTER Vm 

RELATED FORMS OP EDUCATIONAL INVESTIGATION 



W. A. A VEBHiL 
state Education Department, Albany, N. Y. 



The broaden interpretation of the title of this chapter includes 
everything in the whole school world which remains over and above 
the measurements of classroom work discussed in the other chapters 
of this Yearbook. It would call for the consideration of a formid- 
able array of topics of all sorts — from the dust content of school- 
room air to the nature and results of educational legislation — a 
range quite beyond the possibilities of this part of the Yearbook. 
Accordingly, the aim of this chapter will be two-fold; (1) to call 
the attention of superintendents to the different types of investiga- 
tions being made, and (2) where investigations are of a conven- 
tional type, as cost accounting, study of enrolment, etc., to indicate 
present tendencies, rather* than to give a detailed statement of the 
entire field. 

Content of the Course of Study. Possibly the most significant 
t3npe of investigation, as well as one immediately related to class- 
room measurement, is the analysis of the curriculum, both in ele- 
mentary and high schools, with special reference to the content of 
the courses of study and to the relative amount of time devoted to 
the different subjects. Ayres' investigations in spelling have 
pointed the way to the elimination of waste in accomplishing given 
results and have shown which words among the thousands taught 
were proper tasks for the children of the various grades. Similarly, 
the investigations of Bagley and Rugg in history,^ Jessup. in arith- 
metic, and others of the same type have served to indicate the meth- 
ods by which a scientific curriculum may eventually be constructed. 

PupUs' Marks and Scholarship Ratings. Another type of in- 
vestigation most intimately related to classroom measurement is the 



fPor these and other references consult the bibUography, Chapter Xlli. 
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7. TJiomdike's Algebra Test. This is a series of eight exer- 
cises arranged in order of increasing difSenlty as determined by the 
opinion of competent judges. 

II. Drawing 

1. Rugg^s Scale for Measuring Freehand Lettering for Use mi 
Secondary Schools and Colleges. It consists of a series of 8 samples 
of freehand lettering, arranged in the order of increasing merit 
It may be used in measuring the efficiency of a student's work in 
freehand lettering. Address H. 0. Rugg, School of Education, 
University of Chicago, Chicago, 111. (Ref. 156.) 

III. Foreign Language 

1. Brown^s Connected-Latin Test. This test consists of a con- 
nected passage of Latin, to be interpreted in terms of its thou^t 
content The pupils are given a specified amount of time in which 
to interpret and write in English as much of the passage as pos- 
sible. The translation is scored by means of a key. 

2. Brown's Latin^Sentence Test. This consists of a series of 
Latin sentences ranging from very easy to very difficult The sen- 
tences are graded and evaluated, and each is assigned a scale value. 

3. Brown's Formal Latin-Vocabulary Test. A list of fifty 
isolated words which have been graded and evaluated and a scale 
value assigned to each. The pupils are scored on their ability to 
give correct meanings for the words. 

4. Brown's Functional Latin-Vocabulary Test. A list of 
words in the Latin-Sentence Test. The pupils are scored on their 
ability to re-act to these words correctly in their functional rela- 
tionships in sentences. 

5. Brown's Formal LatinrGrammar Test. This test is made 
up of twenty constructions in Latin sentences. The constructions 
are in italics and the pupils are required to name and describe them, 
but not to translate the sentences. 

6. Brown's Functioned LatinrGrammar Test. A series of 
Latin constructions chosen from the Latin-Sentence Test The 
pupils are graded on their ability to react correctly to these con- 
structions in their normal settings. 
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With the foregoing six tests a sarvey was made of the work in 
Latin in New Hampshire secondary schools. The high schools of 
every city and every large town in the state were tested. Most of 
the private academies and seminaries were also reached. The re- 
sults are to be set forth in ai document entitled A Study of AbUity 
in Latin. This will consist of about 300 pages when printed and 
will be published by the Bureau of Educational Research of the New 
Hampshire Department of Public Instruction, Concord. For fur- 
ther information address President H. A. Brown, State Normal 
School, Oshkosh, Wisconsin. (Ref. 277.) 

7. HanMS* Latin Tests. These consist of four tests for vocab- 
ulary, a translation test, and a grammar test All of these tests 
are based on Caesar and Cicero. No words appear in the vocabu- 
lary tests ''which occur less than one hundred times in Caesar and 
Cicero." The translation test "contains only constructions which 
are found at least five hundred times in Caesar and Cicero." The 
grammar test is based on the sentences to be translated. Address 
Paul Hanus, Harvard University, Cambridge, Massachusetts. (Bef. 
278.) 

8. Henmon^s Latin Tests. These consist of (1) an easy hun- 
dred-word vocabulary test — 50 in English and 50 in Latin — con- 
taining the words that are common to four widely used first^year 
books, (2) a standard vocabulary test of 239 words representing all 
the words common to 13 first-year books and to Caesar, Cicero, and 
Virgil, (3) a Latin-sentence test consisting of 30 sentences con- 
structed by using none but the 239 words of the Standard Vocabu- 
lary Test. Address V. A. C. Hennon, University of Wisconsin, 
Madison, Wis. 

9. Starch's French Vocabulary and Reading Tests. The vo- 
cabulary test consists of 100 French words selected at random from 
a French dictionary. The English equivalents of these words are 
given on the test sheet, and the pupil is tested by means of the num- 
ber of English equivalents he can correctiy associate with the 
French words. The reading test consists of simple sentences to 
be translated. 

10. Starch's German Vocabulary and Reading Tests. These 
are similar to the tests for French. Copies of these tests may be ob- 
tained from Daniel Starch, University of Wisconsin, Madison, Wis- 
consin. 
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throughout the state are quickly tabulated, analyzed, and returned 
to the systems which contributed the information. Betums wiU 
be made, it is believed,* in time to be of use to the superintendents 
early in the next school term. Beginnings in this form of 'educa- 
tional accounting' have been made in the principal cities of the 
state and in 12 cities with an elementary enrolment 3,000 to 5,000; 
26 with 1,000 to 3,000 ; 44 villages with 500 to 1,000 ; 58 with 300 to 
500 ; 227 enrolling 100 to 300 elementary pupils and about 100 union 
schools with fewer than 100 elementary pupils. The superintendents 
of these school systems will be glad to exchange data with systems 
of like size throughout the country.^ 

Superintendents willingly receive comparisons of their systems 
with others of like size similarly situated. The first reaction toward 
this matter is an attempt to explain away the retardation and other 
defects; it is only afterwards that the problem of doing away with 
it is attacked. Reducing the figures to common denominators of 
size, wealth, foreign elements and shifting population wins the con- 
' fidence and cooperation of superintendents and principals and 
paves the way for constructive work. The mechanical tabulation of 
the returns also makes possible the correlation of progress-through- 
school with such factors as teachers' salaries, principals' salaries, 
number of pupils per teacher, per capita assessed valuation of the 
school district, number of hours devoted daily to supervision by the 
principal, and in small schools, the number of grades taught by one 
teacher. 

Investigations Giving Rise to Permanent Records. It is of in- 
terest to follow the usual course of many investigations of the type 
mentioned thus far in this chapter. Often the first stimulus to ac- 
tion is a questionnaire received by the superintendent ; next a sur- 
vey of classroom work is made with standard tests; then an age- 
progress survey follows, and the superintendent begins to incorpor- 
ate into his report some of the outcomes. Soon the giving of stand- 
ard tests and the statistical study of school records become a part 
of his regular work. Finally the items of information necessary 
for these investigations become the subjects of permanent record in 
the superintendent's office and appear regularly in his report. 



•Address W. A. Averill, State Education Bldg., Albany, N. Y. 
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Oroups of Related Investigations. There should be mentioned 
here quite an array of investigations, largely correlated with re- 
tardation, progress and the achievements of pupils as measured by 
standard classroom tests, which for want of space can only be listed. 

Studies having to do with 

1. Physical conditions of the children in school (hearing, 
eyesight, development, etc., medical inspection, school lunches, heat- 
ing, ventilation, school furniture, etc.). 

2. Home conditions (sleep, breakfast, play, home study, out- 
side work, etc.). 

3. Special classes (blind, deaf, mentally defective, tubercular, 
super-normal, special promotion plans, coaching rooms, supervised 
study, etc.). 

4. School organization (school prog^ms, recesses, fatigue, 
vacations, division of school year, kindergarten, junior high 
schools) . 

5. Compulsory attendance (delinquency, discipline, truancy). 

6. Social and moral welfare. 

Organization of City School Systems. Different in type though 
related are investigations dealing with the organization and 
administration of city school systems, as represented by the work 
of Cubberley, Strayer, Thomdike and others. Attention is centered 
on the functions of the different ofiScers of the system, and the 
chief purpose is perhaps to determine the proper alignment of 
the functions of the school board and the superintendent. The 
conception of a school organization in which the superintendent 
supervises the educational work and a coordinate business ofiScer 
manages the finances and school plant, is being abandoned in fa- 
vor of an organization in which the superintendent, as the chief 
executive ofiicer of the board, is, next to the board itself, the head of 
the entire system, and the one to whom all other ofiScers, both busi- 
ness and educational, are subordinate. Investigations in educa- 
tional legislation show this same trend. Legislation recently passed 
in New York State gives every city a school organization on the 
plan just mentioned. 

School Buddings. An important series of investigations is 
that dealing with the subject of school buildings. The surveys 
made in Cleveland, Oakland and Milwaukee are typical. The 
grouping of types of school architecture by decades, as in the 
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dereUnd worvey, is a signifieant modem tendency. Sanitation 
and hygiene naturally play a large i»art in these atodieSy as do 
ventilation, illumination and safety from fire. Belated to this 
group are occasional investigations of janitor service. 

Extension and Social Service. Much has also been said and 
written about the wider use of school buildings — their use at 
night and in vacations, school-board policies with reference to 
permitting various organizati(ms to use sehocd buildingB and 
charging for their use. These survcjrs, however, lead into the 
field of community welfare and belong rather to the adult world. 

The Cost of Educational Work. Finally, no investigation of 
educational conditions or work can be considered complete which 
does not show the cost of obtaining the results achieved. The ear- 
lier investigations of cost were largely devoted to teachers' salar- 
ies; indeed, for many years salaries and ''other expenses" were 
about all that could be culled from school accounts. Now, investi- 
gations of school cost fall into three categories: (1) those dealing 
with the classification of payments for school purposes, (2) those 
treating of the accounting procedure which gives the desired 
classification and (3) studies of comparative cost by items, schools 
and cities. 

The present tendencies may be stated as follows: 

The school budget is designed according to function, or the 
kind of work done or service rendered. The four main functions 
are (1) regulative and executive service, (2) property (acquisi- 
tion, construction, equipment, maintenance, and operation), (3) 
instructional, or supervision and teaching, and (4) extension and 
social service. 

School moneys are appropriated by main functions only, all 
details of expenditure are left to the board of education. 

The classification of expenditure involves four things about 
every payment made, namely, (1) the function subserved, (2) 
the character of the payment as a fiscal transaction, (3) the de- 
tailed object of the expenditure and (4) the location in the sys- 
tem to which it is chargeable. 

The accounting procedure itself has been simplified by aban- 
doning large unwieldy forms in favor of smaller loose-leaf sheets; 
by using fiexible code symbols at the top of columns; by using 
voucher-checks and warrants in place of tiie old forms of voucher 
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jacket ; and by the standardization of the size of all blanks and 
cards to the new dimensions used commercially. 

Accounts have been rendered more valuable by including a 
register of orders, a register of accounts payable and an appropri- 
ation ledger showing at any time the unencumbered balance as 
well as the unexpended balance. 

Finally the information obtained is reduced to proper units 
for comparative analysis — ^per capita units, for instructional func- 
tions and square and cubic foot units for building, maintenance 
and operation functions. Graphic presentation is employed where 
ever possible. 

Modem Office Methods and Equipment. As a subject for pres- 
ent and future investigation, mention should be made of the equip- 
ment of superintendents' and school board offices and "modem bus- 
iness methods'' of handling clerical work and routine. The ad- 
ding machine, the calculating machine and the slide-rule will en- 
able one or two clerks to perform a surprising amount of statis- 
tical work. The T-square and ruling pen are easily mastered 
tools for graphic presentation. Time for research is often to be 
gained by a reorganization of office routine and the elimination of 
unnecessary records and procedures. Finally, larger systems can 
solve many of these problems by resorting to the mechanical tab- 
ulation of statistics, both educational and financial. 

Conclusion. The breadth of the field presented by educational 
investigations as a whole has made their mention in this chapter 
disconnected and their discussion, when possible at all, so brief 
as to be perhaps inadequate. After all, we must revert to the sub- 
ject of the other chapters of this Yearbook — the measurement of 
the educational work itself — as* that which is most important, be- 
cause it is most closely related to the purpose of the schools, the 
education of the children who attend them. Other types of in- 
vestigation should serve to throw all possible light on the local 
system in which given educational results appear. They should 
be of aid in effecting that interpretation of classroom work which 
will make for fair criticism and constructive suggestion. In fine, 
these related forms of educational investigation stand as an in- 
terpretative background to the more special measurements that 
mark the achievements of pupils in the schools. 



CHAPTER IX 
STATISTICAL TERMS AND METHODS 



B. B. BUCKINOHAM 
BdaeAtional 8t«tiBtieian, Btat« Board of Edneation, ICsdison, WiaeoBH 

As educational reports multiply, it becomes mcreasinglj 
dent tliat there is undesirable variation in both their method 
langua^. A standard procedure and terminology will be hel] 
both to makers and to readers of reports. Moreover, the app 
tion to education of statistical methods developed in other t 
needs to be made clear. It is the purpose of this paper to e 
what appears to be the best practice and to note the assuinpt 
on which the practice is based. 

In certain sciences a higher degree of accuracy is reqn 
than is possible with a single measurement. Accordingly, a 
measurements ere made of the same magnitude, and their avei 
taken as the true amount. It was early ascertained that tl 
measures showed a certain definite arrangement, in accordi 
with which values at or near the average of all the measures i 
of greatest frequence, and measures which differed from the 
erage were less frequent the greater their difference from it. I 
ther, it was found that the number of measures greater than 
average was likely to be equal to the number less than the 
erage by the same amount. The graphical representation of 
kind of a series took the form which we have lately become fa 
iar with as the 'normal' or 'probability' surface (see Figore 
Measures which differed from the average were thought ol 
being in error, and this lead to the development of what has I 
called the "theory of error" — a theory involving the symmetr 
arrangement of measures of the same thing about the true mi 
ure as represented by their average. 

The assumption was next made that there was an anal< 
between a series of measurements of the same thing, and a sei 
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of single measurements of each of a number of individuals alike 
in some important characteristics. This analogy was found to 
work out very well for biological data. Economical data, on the 
other hand, do not appear to afford the same analogy, and since, 
prior to the recent application of statistics to education these 
methods have been used mainly by biologists and economists, 
statisticians were divided into two schools — ^the one adhering to 
the doctrine of the theory of error, the other rejecting it. The bi- 
ologists, broadly speaking, belong to the former and the econo- 
mists to the latter school. 

The evidence is strong that educational measurements tend 
to resemble those of biology in their structure, i, e., that the theory 
of error applies. Published results often fail to reveal this, but 
when such is the case, it is almost always due to scanty data, or 
to the selection of the children, or to the measuring instrument 
itself. 

It is to be understood that the validity of the statements in the 
succeeding pages of this chapter rests on the assumption that edu- 
cational measurements substantially conform to the arrangement 
which exists among many measurements of the same thing, i, e., 
that they conform somewhat closely to the theory of error, and 
exhibit approximately * normal distribution.' 

A variable is a quantity which under the conditions imposed 
may assume different values throughout the discussion. In re- 
peated measurements of the same thing, the obtained measures 
differ through 'error.* In education, where we make numerous 
single measurements of different pupils grouped together on the 
basis of some common characteristic, each different value con- 
stitutes a value of the variable. The number of problems solved 
correctly by seventeen girls in an eighth-grade class was as fol- 
lows : 9, 3, 7, 8, 5, 6, 7, 6, 5, 7, 5, 6, 4, 8, 7, 4, 5. Bach different 
number in this series is a value of the variable "performance of 
upper eighth-grade girls in solving specified problems in arith- 
metic.*' 

Attention must be given to the nature of the units in which 
the variable is expressed. They may indicate mid-points or lower 
limits, and they are influenced by the accuracy of the measurements 
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upon which they are based, iln the Nassau County Supplement 
to the Hillegas scale, the samples have the following values: 0, 
1.1, 1.9, 2.8, 3.8, etc. If a person reports to the nearest scale value, 
he is using each value as a mid-point, and his rating of a compo- 
sition as 1.9 will mean that it is nearer to 1.9 than it is to 1.1 or to 
2.8 ; in other words, his 1.9 will mean from 1.5 to 2.35. If, how- 
ever, he rates a composition as 1.9 which has at least the merit of the 
scale sample at 1.9, but not as much merit as the sample at 2.8, 
he is using the scale- value as a lower limit, and his 1.9 will mean 
from 1.9 to 2.8. If he reports values between those given on the 
scale such that a composition slightly less meritorious than the one 
at 1.9 would be given a value of 1.8 or 1.7, and one slightly more 
meritorious than the one at 1.9 would be given a value of 2.0 or 2.1, 
then he is attempting to secure a greater degree of accuracy, and 
his 1.9 would mean 1.85 to 1.95. Thus, the same rating may have 
materially different meanings. It is necessary, therefore, that 
the units be accurately defined and that they be given the same 
meaning throughout a given discussion. 

A series in statistics is a grouping of the obtained measures 
of the variable by steps or classes. According to the nature of 
the data, series may be either discrete or continuous. A discrete 
series is composed of separate integers. If we record the number 
of children in each class in a school system, all of our measures 
will be of this nature. For example, between classes of 20 children 
and classes of 21 children there can be no measures. A continuous 
series, on the other hand, is one which is capable of an indefinite 
degree of sub-division. The height of children, their weight, the 
time they take to do a given task, their general intelligence, their 
ability in specific ways, all of these when measured yield continu- 
ous series. We may represent the height of a child as 60 inches, or 
his mental age as 10 years. In these cases, however, our measures 
are only short-hand expressions for ranges whose mid-point is 
the measure as reported. Persons reported as 60 inches in height 
may be anywhere between 59.5 and 60.5 inches. Most measure- 
ments in education yield continuous series. Even when series, 
taken at their face value, are discrete, such as the numbers of prob- 
lems solved, they should be treated as continuous series, because 
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in the abilities which they are supposed to indicate, no gaps occur. 
To say that in a certain class six pupils got 10 examples right, 
only indicates that they had an ability which permitted them to 
work 10 examples correctly, but not 11. Their abilities might be 
more accurately represented, if we had material with which to 
do it, by 10, 10.27, 10.5, 10.84, etc. 

Measures when first received are unorganized, and no definite 
impression may be obtained unless their number is very small. 
The first procedure is to divide them into classes. For example, 
700 measures were obtained from eighth-grade boys who wrote 
Test No. 15 of a series of "Progressive Spelling Tests." The test 
consisted of 50 words. Clearly 700 measures in a hap-hazard ar- 
rangement convey almost no information as to how well these 
boys performed. We may classify the measures, as in Table I, by 
indicating the number of boys who spelled no words correctly, one 
word correctly, two words correctly, etc. This table consists of 
51 classes. 

TABLE I 
DiSTBiBunoN OF 8th-Gbadb Boys Accobdivo to thi KvicBm ow Wobds Thbt 

SPKLLXO OoBBIOTLT "PBOOBBSSiyX SPBLLUTQ TftSTS/' Ko. 16 



No. of 




No. Of 




No. of 




Words 


No. of 


Words 


No. of 


Words 


No. of 


Correct 


Pupils 


Correct 


PnpUs 


Correct 


Pupils 





• 7 


17 


15 


84 


22 


1 


14 


18 


20 


85 


15 


2 


9 


19 


19 


86 


16 


8 


6 


20 


18 


87 


12 


4 


11 


21 


25 


88 


20 


5 


18 


22 


20 


89 


18 


8 


18. 


28 


20 


40 


11 


7 


11 


24 


14 


41 


14 


8 


11 


25 


15 


42 


7 


9 


18 


26 


20 


48 


9 


10 


9 


27 


28 


44 


5 


11 


18 


28 


22 


45 


2 


12 


8 


29 


22 


46 


8 


18 


17 


80 


25 


47 


4 


14 


12 


81 


19 


48 


2 


15 


10 


82 


24 


49 


1 


16 


14 


88 


18 


50 













Total 


700 



Although Table I brings the measures into an orderly arrange- 
ment, it does not show the structure of the series as clearly as does 
Table II which is derived from it, and which exhibits but 10 classes. 
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TABLE 


n 


Dkbitk) tbom Tablb I 


No. of 


No. d 


Word! 


Pvpilt 


Oorrect 




0- 6 


80 


e-10 


88 


11-15 


88 


ie-20 


88 


21-25 


84 


26-80 


iir 


81-85 


88 


86-40 


72 


41-45 


87 


48-50 


10 


ToUl 


700 



In this table each group of meaaares, e. (7., to 5, 6 to 10, ete^ 
is called a class.^ For the Class 6 to 10, 6 is called the lower limUf 
and 10 the upper limit. The cUiss interval is the difference betwe» 
the upper and lower limits. In this instance the« daas interval is 
5 words. The number of measures within each class interval is 
called the frequsncy of the class, and its conventional ^jrmbd is 
''f." The entire tabular arrangement, consisting of classes and 
their frequencies, is called a frequency table or frequency distribu- 
tion. 

On the one hand, it is desirable in the interest of accnracy that 
the number of classes of a frequency table be large, in order that 
the intervals may be small. Obviously, it is much more accurate to 
say that 7 pupils spelled no words correctly, 14 spelled one word 
correctly, etc. (Table I), than to say that 60 pupils spelled from 
to 5 words correctly (Table II). On the other hand, it is desir- 
able that the number of classes be small enough to afford a gener- 
alized or typical result A good rule to follow is : arrange the data 
in as many classes as will secure the greatest regularity of frequen- 
cies, t. e., in accordance with which the frequencies will as nearly 
as possible increase to a maximum near the middle of the range, 
and then decrease to a corresponding minimum. While the ntunber 
of classes in Table I, according to this criterion, is too large, it 
might not be too large if we had five or six thousand measures. 

The graphic representation of the frequency table is called a 
frequency surface or frequency polygon. Figure 1 is a frequency 



^There is 8 slight irregularity in the class intervals in that the first 
class contains six units. 
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sarface corresponding to Table II. Observe that the measares, 
grouped by classes, are arranged along the base line. The height of 
each column erected above a given class corresponds to the fre- 
quency of the measures for that class. These f requ^icies may be 
read from the vertical scale at the left of the figure. 

In Figure 1 the columns rise on either side of the tallest column 
with an approach to regularity. If, instead of 50 words, we had 
500, so that we could make 501 classes, and if the niimber of pupils, 
(i. e., of measures) were indefinitely increased, the perimeter of 
Figure 1 would approach the form of a smooth curve having a single 
peak near the center and sloping toward the base line to the right 
and left 
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Horizontal distancee represent numbers of words correct; vertical dis- 
tances represent numbers of pupils. Data from Table IL 



120 



THE SEVENTEENTH TEABBOOK 




FiouRS 2. Nonnal Surface of Frequency 

The base line of sach a curve is called the abscissa. Along it 
are represented the values of the variable. The perpendicolars 
from the curve of the abscissa are called ordvnates. They represent 
the frequencies of the values of the variable. The longest perpen- 
dicular is called the maximum ordinate, and the measure repre- 
sented on the abscissa at the foot of it is the most frequent one. 
If a curve is of the symmetrical form shown in Figure 2, the maxi- 
mum ordinate divides the area between it and the abscissa into two 
equal parts. A curve of this form is variously called the Gaussian 
curve, the curve of error, the probability integral, or the normal 
surface of frequency. 

If a^^^mooth curve were drawn to fit as closely as possible the 
' frequency surface >pf Figure 1, this type form (Fig. 2) would not be 
accurately reproduced. Spelling ability, however, among eighth- 
grade boys may, nevertheless, be distributed 'normally.' The pres- 
ent state of our knowledge does not permit us to be sure that the 
words selected would register all abilities among eighth-grade boys. 
Again, details, not here reproduced, indicate that the number of 
children was too small to bring out the real distribution. One small 
school furnished more than half the children who spelled from 
to 5 words correctly, and more than one-third of those who spelled 
to 15 words correctly. Their unusually low performance causes 
the first three columns of Figure 1 to be unduly high. The rem- 
edy, of course, is to obtain returns from a great many more children. 

Although the arrangement of many measures in a frequency 
table and their graphic representation by a frequency surface per- 
mit the mind to grasp the significance of the data far more readily 
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than is possible without such devices, nevertheless further simpli- 
fication is generally desirable. The more numerous the measures 
and classes of measures, the greater is the need for concentrated in- 
formation — ^that is, for a single simple expression which shall con- 
tain in itself a summary of the whole series. This is the purpose 
of averages. 

The term average has both a general and a specific meaning. 
In its general sense it means any expression intended to give by a 
single figure, the general weight or typical measure of a series.^ 
In its restricted sense, it refers to the arithmetical mean, i. e,, to 
the sum of the measures divided by the number of them. This is 
what we generally mean when we speak of the average. In edu- 
cational statistics, the term used to express the general concept of 
average is central tendency (C. T.). As has been stated above, 
series of educational measurements, when properly derived, tend to 
exemplify the theory of error, i. e. (to state the case very crudely), 
there is a part of the series where the measures are most numerous, 
while the other measures become fewer, the more they differ from 
the most frequent measure. Unless this condition is approximated, 
it is not appropriate to speak of a * central tendency. ' We may, in- 
deed, make an arithmetical computation. The average of the an- 
nual enrolments of an institution which is steadily increasing in 
size may thus be found and will have its uses, but it will not be 
typical of any tendency in the measures. 

Since we are permitted, however, from the nature of educa- 
tional data to use the term 'measure of central tendency,' it will 
be best to use the term 'average' in its conmionly accepted sense, 
as meaning the sum of the measures divided by the number of them. 
Some writers call this the "arithmetical mean," or simply the 
"mean.'' 

The three measures of central tendency (C. T.) most fre- 
quently used are the average, or arithmetical mean (A), the median 
(M), and the mode (Z). The median has been defined as the mid- 
most measure of a series whose measures are arranged in order of 
size, beginning with the smallest' or the largest. According to this 

definition, the median is the ^^th measure (N being the number 

*See, for example, Zizek, Franz. Averages, 
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of measures) . There are objections to this conception of the median, 
and recent workers have defined it as a point on the scale on each 
side of which half the measures lie when they are arranged in order 
of magnitude. The significance of this definition is that it ^n- 
phasizes the idea of a point on the scale rather than a measure, lie 
measures in Table I are arranged in order of magnitude. Half the 
number of measures (pupils) is 350. From the beginning through 
Step 23, there are 342. Eight more measures are needed to com- 
plete the 350. These are all contained in Step 24, which may, there- 
fore, be called the '^median step.'' Since the series is to be re- 
garded as continuous, we must seek the M — ^the ''point on the scale 
on each side of which half the measures lie" — somewhere in Step 24, 
i. 6., between 24 and 25. We now assume that the 14 measures en- 
tered at "24'' in the table are uniformly distributed between 24 
and 25. Since we need 8 of them, M will be 8-14 of the way from 
24 towards 25. Hence the M is 24+8-14 or 0.57 of the step. The 
step is 1 ; therefore the M is 24.57. If we count from the other end 
of the table, we obtain the same value, thus checking the compu- 
tation.' 

If the data were available only as in Table 11, the M would be 
found to be 24.88, instead of the more correct 24.57, as computed 
from Table I. Thus, the greater regularity of Table II is gained 
at the usual sacrifice in accuracy. 

Series may have but single measures at each value, and there 
may be more or less wide gaps in the values. If the number of 
measures is odd, M is the middle one ; if even, it is the average of 
the two middle measures. For example, if the expenditures per 
pupil for 35 cities are listed in the order of their amounts, M is the 
expenditure of the 18th city. If there are 36 cities, M is the aver- 
age expenditures of the 18th and 19th cities. 

The median may be used when the items have been merely 
ranked, instead of measured. Thus a teacher may arrange the com- 
positions of a class in the order of their merit according to her 



'If there were 701 measures made, let us say, by including one pupil yrbo 
spelled 37 words correctly, we should find the 350.5th measure. We ahoold 
then need 8.5 of the 14 measures at Step 24, and M would be 24.61. 



STATISTICAL TERMS AND METHODS 128 

judgment^ The middle one (or the two middle ones, if there are 
an even number of them) is the typical performance of the dass. 
Such typical samples may be compared with others similarly ob- 
tained at later dates, and thns a showing of the progress of the 
dass may be made. To add to the definiteness of this, the median 
samples may be measored by a composition scale. 

It was pointed out above that the natote of the nnits in which 
measures are expressed must be dearly apprehended and con- 
sistently adhered to. Failure to do this introduces error in all 
the results of statistical analysis. An illustration of such an error 
made in the computation of medians may be found in the report 
of the Salt Lake City Survey. In the Table (p. 140) showing the 
distribution of composition scores by grades, failure to take ac- 
count of the nature of* the unit resulted in reporting medians which 
were too small by an amount greater than the average annual im- 
provement from grade to grade. The teachers rated the composi- 
tions according to the original Hillegas scale. The values of the 
samples on the published scale were 0, 183, 260, 369, 474, 585, 675, 
772, 838, and 937. In reporting the ratings of the teachers, how- 
ever, these values were called respectivdy 0, 1, 2, 3, 4, etc., and in 
computing the median these latter valiies were the ones used, and 
they were called the midrpoirUs of their respective dass-intervals. 
Accordingly, when a teacher rated a composition as 3, (really 369) 
she was regarded as placing it between 2.5 and 3.5. As a matter 
of fact, she was placing it as nearer to 369 than to 260, or 474, and 
the dass-interval was therefore from 314.5 to 421.5. The median' 
for the 4th grade was found to lie four-tenths of the way into the 
dass called " 3 " in the table, and, since the lower limit of this dass 
was taken as 2.5 and the interval as 1, the median was reported as 
2.9. The lower limit, however, for the dass was really 314.5 and 
the interval 107. This yields a median of 357.3 (3.415 + 107 X OA) 
or, shifting the decimal point for convenience and expressing the 
result correctly to one decimal place, 3.6, instead of 2.9 as reported. 

The mode is the most frequent value in a series. As such it is 

*Thi8 may be done very accurately by making all possible comparisons of 
two papers and giving tlie better paper of each pair a preference mark. The 
paper having the greatest number of preference marks is the best paper; the 
one having the next greatest is the next best, etc 
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the most evident measure of O. T. It is what most people think of 
when they speak of the average. A teacher, if asked her pnpils' 
average age, will probably reply by giving the most frequent age. 
The mode, therefore, is peculiarly dependent for its significance, 
and indeed for its existence, on the structure of a series. There 
may, indeed, be more than one mode in a series, but in educational 
work the presence of two or more modes indicates a probable &ult 
in the procedure. 

We may distinguish the empirical mode and the iTieoreiicd 
mode. The fo^rmer is obtained by inspection. It is taken as the 
mid-value of the class-interval containing the largest number of 
measures. It, therefore, depends on the size and position of the 
classes in the frequency table. This suggests that by varying the 
size and position of classes we may obtain different values of the 
mode and by combining them, arrive at a more accurate value of it 
than is possible with a single determination. This method is de- 
scribed in most of the textbooks.*^ 

The theoretical mode is not obtained directly from the data, 
but is the mode which would result from an indefinitely large num- 
ber of measurements sub-divided into very minute classes. Its most 
satisfactory determination is based upon fitting an ideal frequency 
curve to the actual series. The value of the variable corresponding 
to the maximum ordinate of the fitted curve is the theoretical mode. 
Its determination involves some rather advanced work in mathe- 
matics, and it is not being used in educational measurements. A 
substitute for this method has been suggested and is said to work 
well. According to it 

Mode •= Average - 3 (Average - Median) 
The average for the series given in Table I is 23.91. The median, 
as shown above, is 24.57. The formula just cited yields 25.89 as 
the value of the mode. 

When the performance of pupils is recorded in the form of 
rates, e. g,, of words read per second or letters written per minute, 
a measure of central tendency sometimes used is not the average 
of the rates, but their Tiarmx)nic mean. This may be defined as the 



■See Bowley, Arthur L., The Elements of Statistics, London, 1907, pp. 
llSff.; also King, Wilford I., The Elements of Statistical Methods, New York, 
1912, pp. 122-125. 
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reciprocal of the average of the reciprocals of the recorded meas- 
ures. Suppose five pupils read at the following rates per minute: 
A, 80 words ; B, 100 words ; C, 120 words ; D, 140 words ; and E, 
160 words.^ The average of these rates is 120 words per minute. 
The reciprocal of each rate expresses the acttuil time required by 
each pupil to read one word. Thus, A required 1/80 min., or 
0.0125 min., to read one ward; B's time was 0.01 min.; C% 
0.00833 min. ; D's, 0.00714 min. ; and E% 0.00625 min. The aver- 
age of these is 0.00884 min. It shows the average time required to 
read one word. The reciprocal of this average of reciprocals is 
1/0.00884, or 113 — ^the average number of words read per minute 
as computed by finding the harmonic mean. Note that we have 
fotind the average of the reciprocals of the rates and taken the 
reciprocal of the result. The average rate by this method is 113 
words, while the average by using the rates directly is 120 words. 
The harmonic mean is always less than the Average. It is, there- 
fore, clear, that results as found by different investigators are only 
comparable when computed by the same method. 

On practical grounds it is difficult to see why we need the har- 
monic mean as an alternative method in computing the central 
tendency of rates. There is no essential difference between rates 
per unit of time and certain economic measures such as wages per 
day. It is certainly not customary to express the central tendency 
of the wages of a group of workmen by using the harmonic mean. 
In the judgment of the writer, the introduction of this method in 
educational reporting serves no useful purpose. 

A measure of C. T., although indispensable, by no means suf- 
ficiently represents a series. It gives but one of the two chief char- 
acteristics of it. The second of these is the closeness with which the 
measures group about the C. T. The measure of this characteristic 
is called the mensure of variability, or dispersion. There are three 
such measures in common use, and one of them should be used and 
reported, not only for its own sake, but also as a criticism of the 
measure of central tendency. All measures of variability, like those 
of C. T., are expressed in units of the series. For example, if the 
units of the series are words spelled, the C. T., as well as the varia- 



*Graj, William 8., Studies of Elementary-Scho&l Beading Through Stand- 
ardieed Tests, p. 15. 
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bility, will be expressed as a certain ntunber of words. The aver- 
age deviation (A. D.) — also the mean deviation, or mean variation- 
is simply the average of the amount by which each of the measares 
differs from the average, median, or mode. It is being suggested 
by several writers that on theoretical grounds the A. D. should be 
computed from the median, because when so computed for any 
series, it is at a minimum. People in general do not sense the mean- 
ing of the A. D. or any other measure of variability as readily as 
they do a measure of central tendency. The A. D. may be thought 
of as the amount by which every measure of the series might diff^ 
from the C. T. without influencing it. 

The standard deviation (S. D. or u) is another measure of 
variability. It is found by squaring the difference between the in- 
dividual measures and the C. T., adding these squares, dividing by 
the number of measures, and extracting the square root of the quo- 
tient. The S. D. is theoretically the best measure of variability — 
at least when the series is 'normal' or nearly so. Its meaning, how- 
ever, is not apparent to the lay reader, and it is difficult to explain 
in terms of the series. If, in Figure 2, perpendiculars are drawn 
from the two points on either side of the maximum ordinate at 
which the curve changes from concave downward to concave up- 
ward, the distance along the base line from the foot of the maximum 
ordinate to the foiot of either perpendicular represents the S. D. 
Between these perpendiculars a little more than two-thirds of the 
area of the curve is included. In series, therefore, which approxi- 
mate the normal type, we may expect about two-thirds of the meas- 
ures to differ from the C. T. by not more than the standard devia- 
tion. The S. D. is at a minimum when computed from the average; 
and according to the best practice, it is therefore taken from that 
measure rather than from the median or mode. 

The quartUe deviation (Q) is half the range within which the 
middle half of the measures lie. In its computation one finds the 
three points in the range which divide the number of measures into 
four equal parts. These points are found in exactly the same way 
as the median. The points on the range at which these divisions 
fall are called the quartiles. The first, or lower one, is called the 
lower quartile, or 25-percentile (Qj) ; the third or highest one is 
called the upper quartile, or 75-perdentile (Q3). The second one, 
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of course, divides the measures into the two equal parts and is the 
median ; it is not, therefore, referred to as a quartile. The differ- 
ence between the upper and lower quartile is the range within which 
half the measures lie. This difference divided by 2 is Q. In the case 
of normal distributions, it is called the probable error (P. E.). 

It is important that the student of educational statistics should 
understand not only that A. D., S. D., and Q are measures of varia- 
bility, but also that they are themselves important units of amount, 
and that for some purposes they replace the units in which the 
measures were recorded. Suppose that a group of eighth-grade 
pupils is tested in arithmetic and in handwriting. If a certain 
pupil scores 17 examples correct in arithmetic, and Quality 75 in 
handwriting, according to the Ayres scale, it is impossible to say 
how much the one performance is better than the other, unless both 
performances are expressed as a certain number of A. D's or Q's 
above or below the median of the group. Either of these units, or 
the S. D., will serve to express the measures of a series in such a 
way as to permit comparison with the measures of another series 
expressed in the same units of variability, even though the original 
units of the two series are different. 

If it is desired to compare the variabilities of two different 
series, we can hardly do so by using either of the three measures 
described above. If, for example, a group of children is rated in 
composition by the Nassau County Supplement to the Hillegas 
Scale, and in spelling by means of a list of 100 words, since the 
possible range of achievement in composition is only from to 9, 
while in spelling it is from to 100, the variability in the latter 
case will appear to be much greater than in the former. Under such 
circumstances, it is customary to divide the measure of variability 
by the C. T., the result being the so-called coefficient of variation. 
Generally speaking, it is an error in method to compare the meas- 
ures of variability of two series unless the series are expressed in 
the same units and have approximately the same C. T. 

Although the analysis of series may be carried to higher de- 
grees of refinement, educational workers report few measures other 
than those of central tendency and variability. No small space, 
however, in educational literature is devoted to the determination of 
the degree of correlation, or mutual implication, existing between 
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paired measures of different traits or performances. Thus, if 100 
high-school children are rated in Latin and in algebra, the extent 
to which an individual having high, medium, or low ratings in one 
subject tends also to have high, medium, or low ratings in the other, 
indicates the correlation for the group in question between ratingB 
in Latin and ratings in algebra. Various methods have been de- 
vised for giving numerical expression to this correlation betweoi 
two series of paired measures. Two of the methods suggested by 
Spearman — ^the ''Rank Difference" and the ''Footrule^— depend 
on the extent to which the individuals ranking first, second, third, 
etc., in one series tend also to rank in the same order in the other. 
Such a correspondence in ranking would indicate perfect correla- 
tion, and would be expressed by the integer 1. By another method 
(suggested by Sheppard) each measure in the two series is given a 
sign plus or minus, according as it is greater than or less than the 
central tendency, and the number of times a plus or a minus sign 
in one series goes with the same sign in the other series for the same 
individual is noted. The greater the proportion of ''like-signed 
pairs," the greater is the correlation. The formula which is used 
in connection with this method again yields "1" as the measure of 
perfect correlation, i. e., as the measure obtained when all the pairs 
of signs are alike. 

Still other methods are used, but the so-called product-moment 
method is the one most commonly accepted. The meaning of the 
formula used in applying this method cannot be made dear in a 
brief description. The reader is referred to any textbook on statis- 
tics for a treatment of it. The measure of correlation yielded by 
this method is called the correlation coefficient, and its symbol is 
**r." To such an extent is the product-moment method, the stand- 
ard in statistical work that coefficients derived by other methods 
are usually converted into it. 

In determining the degree of correlation which subsists in a 
given group with respect to two measurable characteristics, it must 
be emphasized that the individual measures, pair by pair, are to 
be used. It is not correct procedure to break the group up into 
smaller sub-groups and to compare the averages in the two charac- 
teristics for each group. Averages obscure individual variations 
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and it is precisely the individual variations which are important in 
securing a correlation coefficient. 

The correlation coefficient as an expression of relationship has 
been uncritically adopted. It is a measure of mutual implication. 
It fails to indicate the extent to which either of the measured char- 
acteristics depends upon the other. It may, however, be used in 
finding other expressions which do so. Thus, statisticians, while 
becoming more critical of the correlation coefficient, are using it to 
determine the two so-called regression coefficients, which permit a 
statement of the chance in one characteristic likely to accompany 
a unit change in the other. I found, for example, that the correla- 
tion coefficient between achievement in answering thought and mem- 
ory questions in history was +0-40. This was not nearly so inform- 
ing as were the regression coefficients, one of which showed that suc- 
cess in answering thought questions accompanied success in an- 
swering memory questions to the extent of nearly 0.90 — ^'*1" being 
the maximum. The other regression coefficient, t. e., of 'memory' 
on 'thought,' was less than 0.20. 

Most of the foregoing statements, and many others not made 
here, depend to a large degree for their validity upon the existence 
of 'normal' distributions. Although the ability of school children 
in a given grade is presumably close to normal, measurements ob- 
tained from test material often fail to support the presumption. 
Aside from the fact that the pupils 'measured' are often relatively 
few and poorly selected, and that results are frequently scored by 
interested or indifferent persons, there is another important reason 
for this — a reason which has to do with the test itself as a measuring 
device. 

It is necessary, in the first place, to understand clearly what it 
is that we are measuring when we test school children. Mr. Courtis 
has pointed out a useful distinction between capacity, ability, and 
performance.'^ Capacity, as he defines it, represents the possibility 
of development — ^the natural endowment of the individual. It is 
his potential ability, and is independent of training. The ability 
of an individual is defined as the power actually developed by the 
effect of training upon inherent capacity. Performance is the spe- 

HTourtis^ S. A., TMrd, Fourth, and Fifth Annual Aeoountings, 191S'19ie. 
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cific achievement of an individual resulting from his ability as 
evinced under the conditions of the test 

Although we may have good reason for supposing that the 
distribution of school ability is closely similar to normal distribu- 
tion, we see in the distinction which has just been made, that what 
we are really measuring is not ability, but performance, and that 
while ability may be constant at any particular time, performance 
will vary according to the conditions under which the ability mani- 
fests itself. This constitutes a real difficulty in educational meas- 
urements, especially when conclusions are drawn concerning m- 
dividuals rather than groups of individuals. It has been proposed 
that as many as twenty-five tests of a single individual ought to be 
made and the average of the results used before we can be reasonably 
certain that we have a reliable measure of performance. This is 
an extreme point of view and seems hardly to be tenable. Courtis 
has shown that if children are given a second test, only about 20 
percent of them will show marked diflPerences in performance. He 
has also shown that giving additional tests does not materially 
change the score for a class as a whole. 

Since, however, what we are measuring is performance rather 
than ability, our tests must be so constructed that performance will 
tend to vary with ability, i. 6., to be an index of it. Thus, the con- 
formity of the resulting measures to a normal distribution furnishes 
a criterion for judgment as to the adequacy of the test material. 
Assuming that ability is distributed approximately normally, it 
is highly desirable that the test material should be such as to bring 
out that form of distribution. Too often this is not the case. On 
this ground a great deal of test material now being used in edu- 
cation is faulty. For example, most of the testing which has been 
done in spelling by using Dr. Ayres' list has resulted in a large 
number of perfect papers, or papers that were nearly perfect. This 
is because the examiner has chosen words which Dr. Ayres found 
possessed little difficulty for the grade in question. Recently, re- 
sults were published from the use of words, each of which, accord- 
ing to Dr. Ayres' list, had been spelled correctly by 88 percent of 
the children. Naturally, a very great number of the children 
spelled all the words correctly. Under such circumstances, no meas- 
ure of central tendency could be regarded as significant In the 
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fourth grade, 15 percent of the children wrote perfect papers. More 
of them spelled all the words right than spelled any other number of 
them. The test material was too easy to register variation in per- 
formance among the more capable children and therefore failed to 
afford any index of their ability. It is certain that among the chil- 
dren who spelled all the words correctly there was a wide difference 
in ability which would have caused a correspondingly wide differ- 
ence in performance, if the material had been capable of showing it. 
The same inadequacy of test material is revealed when it is too diffi- 
cult for the pupils to whom it is presented. Under such circum- 
stances a large number of children of varying degrees of ability 
will be unable to register any performance in teims of the test. 
For example, in a certain test in arithmetic 145 children out of 943 
were reported as unable to solve a single problem. Among these 
children large differences in performance corresponding to large 
differences in ability would have been indicated by a different test, 
t. e., by one easy enough to enable them to accomplish something. 

The best test material will be found to be midway between that 
which, through being too easy, fails to register variation among the 
pupils of greatest ability, and that which, through being too diffi- 
cult, fails to register variation among those of least ability. A 
spelling test, for example, composed of words, each of which may be 
expected to be spelled correctly by 50 percent of the children in the 
grade taking the test, will afford ideal results. In general, test 
material is more adequate which yields a series of measures with an 
approximately normal distribution. Any piling up of measures 
at either the high end or the low end of the range is a defect. Such 
material is impossible when given to pupils in several successive 
grades. In the writer's judgment, no test is satisfactory when used 
in grades more than two years apart. 

Various types of tests are being used to measure educational 
products in terms of the performance of children. Dr. Ayres has 
distinguished three. First, there are those in which the material 
is arranged by steps of increasing difficulty from very easy to very 
hard, such as Gray's Oral Reading Scale, and Woody 's Arithmetic 
Scale. These may be called difficulty tests. They measure **how 
hard." Second, we have accuracy tests, or those which measure 
''how well." Examples of these tests are the various reading tests 
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which measure the quality of reading by the accuracy of the re- 
production of it. Third, we have tests in which the material is in- 
tended to be of the same difficulty throughout, and in which the 
pupil is required to do as much work as he can in a given time. 
This kind of test may properly be called a speed or rate test. It 
measures ' * how much. ' ' Doubtless we should measure performance 
by all three of these devices. Ultimately we shall have at each point 
of difficulty as set up in the first type of tests, a large number of 
elements — ^words, problems, passages to read — each of the same dif- 
ficulty. The arithmetic tests used in the Cleveland Surv^ are an 
approach to this. The criticism of the difficulty tests which have 
a single element at each step is that the difficulties of the elements 
are of different kinds. The criticism of the accuracy and rate tests 
is the varying difficulty of their elements. If, however, we have a 
large number of elements at each level of difficulty, we may th^ 
apply the kind of measurement used in the second and third types 
of tests, and, vritJiin the difficulty in question, we may measure both 
'*how well" and '*how much." Under such circumstances, oar 
record of performance would, so to speak, consist of three dimen- 
sions. It would also affofrd a better index of ability. 

Meanwhile, many new tests are needed, as well as much re- 
finement of the material of tests now in use. It is unnecessary at 
this time to decide the relative merits of difficulty, accuracy, and 
rate tests. At present, the best criterion to apply to these types 
of tests is that of the regularity of the series of measures derived 
from them. If we are warranted, as it seems we are, in inferring 
that ability is distributed with an approximation to normality, then 
the highest requirement on the part of a test is that it measure per- 
formance in such a way as to be a true index of ability. The con- 
ditions under which tests are administered and the methods by 
which they are rated must be rigorously controlled, but the first 
requirement is that the means of measurement should be sensitive 
instruments, capable of registering variation in the things which 
they presume to measure. We may labor ingeniously at our anal- 
yses of results and may bring from afar the most potent methods 
which statistical theory has evolved, but we shall accomplish little 
if our instruments are as grossly defective as some of those which 
are now being employed appear to be. 
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The rapid growth of the movement for measurement and the 
importance of the knowledge gained from surveys and experimental 
studies have led to a demand for definite training in measurement 
work. From superintendent to teachers, educational workers have 
been quick to recognize both the possibilities of the new tools and 
their own need for training. Wherever courses in measurement 
have been offered, the response has been surprisingly large. As a 
result the number of courses available in colleges and universities 
is steadily increasing and their influence is spreading to other fields. 
There are few teachers' institutes which do not touch upon some 
phase of measurement work, and few normal schools or other teacher 
training agencies which are not beginning to arrange for systematic 
instruction along these lines. At present there is, as might be ex- 
pected, almost no agreement as to the aim or method. The courses 
range from the shallowest survey of the literature of the field, to the 
most highly technical and theoretical courses of university psychol- 
ogy. It may not be out of place, therefore, to give some account of 
the needs of teachers as seen by one who has served for several 
years as director of research in a large city school system. 

The primary aim of all courses for teachers must be to increase 
the teaching power of the students. But teachers are the stuff 
from which principals, supervisors, and superintendents are made, 
so the training courses must be both broad enough, and wide and 
deep enough to give some knowledge of the administrative and 
supervisory uses of tests as well as of their instructional and diag- 
nostic functions. For most teachers, practically the only opportun- 
ity to consider the workings of the school system as a whole and to 
think about educational problems from the supervisory and admin- 
istrative standpoints is that which comes to them during the period 
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of training. Therefore, while the measurement work in a normal 
dchool should center around the direct application of measurement 
to the solution of problems of teaching, the broader aspects of the 
results secured must not be overlooked. 

The desirable outcomes of courses in measurement, as of other 
instructional work, are of four different types — (1) point of view, 
(2) knowledge, (3) skills, (4) power. Each of these will be dis- 
cussed in turn. 

1. Of all the possible outcomes of training work in measure- 
ment, none is so important as the effect upon the student's point 
of view — upon his attitude, not only towards scientific experimenta- 
tion in education, but also towards his educational experiences and 
life. For, too often, normal-school courses result merely in giving 
the prospective teacher the idea that everything in education is 
settled. A textbook is necessarily dogmatic in statement. Courses 
in methods and teachers in charge of training necessarily tend to 
stamp this as right and that as wrong. The training period is al- 
together too brief to do more than outline existing ideals and prac- 
tices, and indicate those that are **the best." Even practice teach- 
ing under expert guidance usually serves but to give practical 
experience in ** handling a room" and in conforming to teaching 
routine. Occasionally, a student of exceptional intelligence senses 
the contrast between ideals and existing conditions, but even his 
experiences seldom stir more than questionings and dull resent- 
ment. 

Teaching, itself, is even more deadening to initiative. In all 
systems of any size the courses of study, and often the method to 
be used, are fixed by higher powers. The equipment, the time allow- 
ances, the size of classes, the types and abilities of the children, are 
all beyond the teacher's control. What is there in the training or 
expeiience of the average teacher to develop openness of mind, 
or give any conception of our present educational process as a crude, 
inefficient, wasteful makeshift, established **by guess and by gosh," 
and maintained by cofnvention and social inertia? 

Therefore, it should be the supreme function of measurement 
courses nn normal training — as it has proved to be in the educa- 
tional activities in the world outside the school — ^to give the student 
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the scientific attitude of mind, the critical, impersonal, and inquir- 
ing point of view. They must teach him how knowledge arises and 
make him feel the cost in time and labor by which the present levels 
of civilization have been attained. They should so clearly reveal 
the part that measurements and scientific methods have played in 
every field of human activity that he will realize their importance 
in education and desire to make himself proficient in their use. 
They must give him bases of criticism and arouse in him such a 
passion for truth that all his life long he will constantly seek to test, 
open-mindedly, disinterestedly, impersonally, the validity of all 
conclusions. They should lead him to regard all educational ac- 
tivities as problems in course of experimental solution, so that he 
will be ever on the watch for those significant variations which make 
for progress. Above all, they must so open his eyes to the wonders 
of the educational process, the possibilities of child development, 
and the relation of progress in education to progress of the world 
that he may have an abiding faith in the dignity and value of his 
profession and a burning zeal to make some contribution to the 
progress of the race. If the courses do this, they will be counted 
successful long after all technical knowledge and skill has been for- 
gotten ; if they do not, they are failures, although their graduates 
know every test by name and are past masters in the art of compil- 
ing tables and graphs. 

2. On the side of knowledge there is much to be learned. The 
student must acquire by actual experience, knowledge of the differ- 
ent types of tests and the advantages and limitations of each. He 
must be familiar with the methods of test and scale construction 
and must have a first-hand experience in giving and scoring the 
more important of the available standard tests. He needs to know 
where to go for standards and comparative data, and he should 
have made a careful, critical study of two or three typical survey 
reports. He must be given, also, some experience with the varia- 
tions in performance caused by changes in conditions and must 
learn how these are to be controlled and interpreted. More than 
anything else, his practical work must serve to emphasize the differ- 
ence in individual children and the need of adjustment of training 
to such differences. 



186 ^BiB SEVENTEENTH TEABBOOK 

It is not enough, however, that the teacher in training have a 
practical working knowledge of educational tests; he must know 
also tests in related fields. He should be given more than a passing 
acquaintance with physical measurements — height, weight, lung 
capacity, and their significance, and simple tests of vision and hear- 
ing. He needs ali90 some knowledge of the methods and tests em- 
ployed in measuring intelligence and capacity. Further, he needs 
practice in the construction of rough tests and examinations, and 
the formulation of aims in terms of objective standards. Knowledge 
that is only knowledge, is vain. If the knowledge outlined above 
is merely memory of things read or transmitted by word of mouth, 
it will be of little worth. It should be knowledge derived from per- 
sonal experiences. 

3. The other product of experience is skill, and the successful 
course in educational measurement will have as one of its outcomes, 
the ability to pass certain standard tests in. statistical methods ; for 
instance, rate tests in making typical distributions, in finding aver- 
ages and medians, in computing median and standard deviations, 
in calculating coefKcients of correlations, and in drawing graphs. 
Even more important than these are standard tests of ability to 
use educational scales in a consistent manner. There should be 
training on some of the standardized samples which have been pub- 
lished in writing and composition, until a set of 20 test samples can 
be marked without a variation of more than half a step of the scale. 

Only as the course results in a measurable proficiency in these 
fundamental skills should it be counted successful. Not all persons 
have the mental qualifications that make possible accurate judg- 
ment by means of a scale, and not all have the aptitude for statis- 
tical work; but all teachers, without exception,ne6d to have meaS' 
ured themselves against siich objective standards, both that they 
may know their own powers or limitations, and that they may un- 
derstand the method and aims of those who have the measurement 
work in charge. The greatest obstacle to harmonious, cooperative 
work in a city school system is the misunderstanding of those who, 
through ignorance, misinterpret the aims of the measurement work. 

4. Finally, the successful courses in measurement should re- 
sult in power to use measurement in the solution of educational 
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problems. That is, for full credit, the student should be able to 
pass successfully three types of power tests; (1) he should have 
planned, measured, and compared the effects of his own and an- 
other's teaching of a specific instruction unit, like the teaching of a 
given twenty words in spelling, or a certain case in long division ; 
(2) he should have devised, executed and interpreted a simple con- 
trol experiment to settle some problem arising out of his practice 
teaching; (3) he should be able to diagnose by means of appropri- 
ate tests, and to prescribe the remedy for, the more common causes 
of failure in the fundamental subjects. No teacher who has had the 
practical experience with tests and testing that will enable him to 
meet these requirements will ever be willing to teach without the 
aid which standard tests afford. 

There are five major articles in the writer's educational creed: 

1. Basic experiences cannot be transmitted by instruction. 

2. Understanding of the value of tools is best learned by their 
use as a means to an end. 

3. Skill in the use of tools is best developed through drill. 

4. Outcomes related to self-interest have greater educational 
potency than abstract aims. 

5. All training work must be adjusted to the varying capaci- 
ties and interests of individual students. 

Expressed in terms of method of teaching a course in meas- 
urement these mean : 

1. That the work must be ** practical" in character. 

2. That it must center around, and have for its purpose, the 
measurement, and improvement, of the practice teaching. 

3. That it must consist mainly of laboratory work with only 
as much lecture work an^ reading as is necessary to connect the ac- 
tivities of the course with similar activities in the school system 
and in the educational world outside. 

4. That it should consist of a series of graded exercises or 
projects grouped around the main topics in such a way as to pro- 
vide for individual progress and differences in interest. 

It seems futile to attempt to give more specifically a statement 
of precise topics covered, or the length of the course in terms of 
years or hours. Adjustment must everywhere be made to local 
conditions. But the material available and its importance warrants 
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the prophecy that in a very short time the work in measurement 
will be a major subject running through the entire period of train- 
ing. For a six semester course (four semesters in school and two 
actual teaching under supervision), the following might serve as 
a general program. For shorter courses, the actual amount of work 
done would be correspondingly decreased. 

Semester I. General principles of measurement, including 
physical and mental tests, and elements of statistical methods, with 
special emphasis on individual differences, the factors causing vari- 
ation, and the need for control of conditions. 

Semester II. Use of the simpler standard tests in measuring 
the effects of practice teaching. 

Semester III. Measurement by means of the more complex 
tests, with special emphasis upon correlation of abilities and analy- 
sis of complex ability into simple elements. 

Semester IV. Measurement of the results of educational ex- 
periments and of the effect of remedial work with individual chil- 
dren. Emphasis on the diagnostic and supervisory uses of tests, 
both for individuals and for a school system as a whole. Class as- 
signments mainly individual projects, or actual participation in 
surveys and other practical testing work. 

Semesters V and VI. Period of probationary teaching. Re- 
ports to supervisory officers to be based on the use of standard tests 
of the results of teaching effort. 

An appropriate conclusion to this chapter is a comment on 
that anomaly — a course on educational measurement in which no 
use of measurement is made, either as a basis of adjusting the work 
to the abilities of individual members of the class, or as a means of 
measuring the efficiency of instruction. As long as educational 
training concerns itself with superficial conformity to conventional 
practices and hasty surveys of educational literature, little in the 
way of progress can be expected. But if the work in the training 
and practice schools is actually the most efficient in the system, and 
if there, the teacher-in-training learns to see problems as problems, 
and to attack them with the best tools and methods, the training 
which he receives will function all through his professional life. 
Probably upon the character and practical value of the instructions 
given to prospective teachers, more than upon any other one factor, 
depends the success of the movement for measurement and the char- 
acter of its future development. 
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CHAPTER XI 

SUGGESTIONS FOR EXPERIMENTAL WORK 



BY GEORGE MELCHEB, 

Director of Bureau of Beseardi and Efficiencj, 

Public Schools, Kansas Citj, Missouri. 



Empiricism and Science in Education 

The United States has no national system of education. Each 
state, each municipality, each school district plans its own course of 
study, determines its own school organization, supervises its own 
school work, chooses its own plan of procedure, establishes its own 
standards. Our nation is called *'the world's greatest experiment 
in democracy.'' With equal truth it could be called '*the world's 
greatest experiment station in education. ' ' All kinds of educational 
problems are being attacked experimentally — ^problems in the ad- 
ministration, the supervision, the teaching and the financing of 
schools. All varieties of curricula are involved, all kinds of school 
equipment and appliances, and every conceivable method of teach- 
ing the various subjects. 

Many communities believe that their methods of school pro- 
cedure are the best. Yet they are wholly without scientific evidence 
in support of their belief. Thus it is often easy for an enthusiastic 
devotee of some new method of procedure to influence the agencies 
of control to such an extent that an entire school organization is 
revolutionized. Witness the change of a large number of elemen- 
tary schools in New York City to the Gary plan of organization. 
We are not arguing that New York City has not improved her 
schools by the change ; for we do not know whether she has or not. 
New York City does not know. No one knows. The Gary System 
may have many valuable contributions to make to education. The 
point is that the plan is new and has not been in operation long 
enough to have demonstrated its superiority over the conventional 
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school organization. Yet, in spite of that fact, the Gktry system has 
been and is being enthusiastically copied not only in New York City 
but in many other communities as welL In like manner, countless 
other changes in school organization and school procedure are be- 
ing made year after year on the basis of plausible arguments; and 
no one is able to demonstrate the wisdom of the change. In many 
cases a few years later the school returns to its original plan. Wit- 
ness the more recent action at New York in abandoning the Gary 
plan after spending several million dollars in introducing it. Could 
industrial establishments succeed by such methods? 

School authorities are constantly changing methods of pro- 
cedure, and courses of study. This harasses teachers, annoys pa- 
rents, lowers the efficiency of work, and destroys the confidence of 
the public in its school system. Such arbitrary orders are based 
merely on the personal opinions of those in authority. Even up 
to the present time, almost every school policy has been adopted on 
insufficient evidence or upon no evidence at all. In other words, 
personal opinion decides the destinies of school children and de- 
termines school curricula and school organization. Scientific 
methods have been recently introduced into industrial work, busi- 
ness, agriculture, and many other forms of human activity. Even 
the church is having its methods subjected to rigorous criticism 
from the standpoint of efficiency. In the management of the war, 
we see great nations struggling to apply every known scientific 
principle. Certainly education, the most important of human in- 
dustries, cannot afford to neglect any opportunity to test scien- 
tifically its methods of procedure and to demonstrate the value of 
its results. 

In this chapter I am to make a few practical suggesticms that 
may be helpful to the teacher, principal, supervisor, or superin- 
tendent who desires to contribute his "bit" to educational progress. 
These suggestions will be valueless to the persons who still believe 
that we can measure achievements in school work by the personal 
opinion — ^frequently the offhand and prejudiced opinion — of some 
one individual. We know that improvement in all human activities 
depends very largely upon critical studies of existing conditions and 
upon the establishment thereby of standards to be attained at each 
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stage in the development of these activities. It is evident that 
progress in education is dependent upon a similar process. The 
inability of school administrators in the past to make reliable meas- 
urements has greatly retarded progress. It is true that th^ have 
been able to measure such facts as per capita costs, numbers and 
ages of graduates, the percentages of retardation, etc. Helpful as 
such measurements are, they fail to yield the information upon 
which an adequate appraisal may be based. The recent development 
of means of measurement, however, permits true educational ex- 
perimentation. 

Method of Compabison 

In order to determine progress in any phase of school work, 
one must first analyze the situation to discover, as far as possible, 
the various factors that enter into it. These factors must then be 
studied singly and the effect of each determined. It is the analysis 
of these complex situations and the study of each of their factors 
that renders educational measurement so difficult. This is espe- 
cially true in attempting to compare the efficiency of different meth- 
ods of school supervision, organization, or administration. 

It is probable that experimental work can render its greatest 
service by being applied to a study of methods of teaching and of 
the orgajiization of subject matter. These problems are constantly 
before superintendents of schools and one or more of them can be 
selected each year for special study. The mere fact that they are 
being studied will have a beneficial effect upon the school system. 

As we do not have standards in all school subjects, it is nec- 
essary to employ many other means of measuring school achieve- 
ments. One device, concerning which a few suggestions will now 
be offered, is the 'Control Experiment.' In order that the con- 
clusions from a control experiment may be of value, a careful plan 
of procedure must be followed. 

First. Analyze your situation and select one factor to be 
studied. 

Second. Select two groups of pupils approximately equal in 
number, in ability, and in previous training. Each group may con- 
sist of one, two, three, or more classes. 
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Third. At the beginning of the experiment, careftilly meas- 
ure the ability of each pupil in the factor under consideration. 

Fourth. Select teachers who are open-minded. If possible, 
select those who know something of scientific methods. Especially 
select those who are willing to cooperate and who appreciate the 
value of following directions. The teachers should be as nearly 
equal as possible in teaching ability. 

Fifth. Prepare carefully detailed instructions for all teach- 
ers who are participating in the experiment. 

Sixth. Except for the one factor that is being studied, keep all 
the conditions in the two groups as nearly equal as possible during 
the progress of the experiment. 

Seventh. Continue the experiment long enough for material 
changes to be made — several weeks, half a year, or even more may 
be necessary. 

Eighth. At the conclusion of the experiment, carefully meas- 
ure the ability of the pupils in the factor under consideration. 

Ninth. Base conclusions as to relative efficiencies upon a study 
of gains and losses of only those pupils who were present through- 
out the period of the experiment. 

Tenth. Allow for the effects of any varjdng factor other than 
the one under consideration. 

Eleventh. Avoid conclusions from insufficient data. 

Twelfth. Record and preserve the details of the procedure. 
It may prove to be desirable to check the conclusions by repeating 
the experiment. 

ExpiANATiON OP Steps in Plan 

First. School results arc complexes. Many factors usually 
contribute to a single result. In a control experiment only one 
factor should be varied and studied in order to determine the effect 
of that factor; as, for example, the proper distribution of time in 
teaching penmanship. Assume that sixty minutes a week may be 
devoted to the teaching of penmanship in the fifth grade. The fol- 
lowing question arises: ''Shall this time be divided into five 12- 
minute periods a week, four 15-minute periods, three 20-minute 
periods, or two 30-minute periods t" An experiment designed to 
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answer such a question should provide for four groups of fifth-grade 
pupils, each working with one of the suggested distributions of the 
60 minutes per week to be devoted to penmanship. It may be that 
a different distribution of time would be advisable in other grades. 
Hence, similar questions remain to be answered for grades below 
and above the fifth. 

A second question and one entirely different from the one above 
is, *' What is the number of minutes a week in each grade that 
secures best results in the teaching of penmanship?'' Note that 
this is an entirely different question from the first and cannot be ^ 
studied at the same time without confusion of results. 

Still a third problem r **To what extent can progress in writ- 
ing be secured without regular drill periods in the various grades?" 
This problem involves entirely different elements from the first and 
second problems and cannot be studied in connection with them. 
One factor only in a situation can be successfully studied at a time. 

A pupil's ability in any subject is not a single general ability 
but the resultant of several special abilities. For example, in arith- 
metic there are an almost unlimited number of abilities, as ability 
in adding long columns, short columns, small numbers, large num- 
bers, etc., different abilities in subtracting, multiplying and divid- 
ing whole numbers ; different abilities in operations in fractions, as 
in adding, subtracting, multiplying, dividing, reducing, etc. A 
given control experiment can deal with only a single ability or a 
single factor in a situation. The science of education will' be per- 
fected by solving correctly the numerous small problems involved 
in the educative process, as successful manufacturing is perfected 
by handling correctly each detail of its work.^ 

Second. In the type experiments to which I have referred 
in the preceding paragraph, the number of pupils is not large. 
Larger numbers of pupils add to the reliability of the results, al- 
though they make more difficult the control of all the factors in- 
volved and the maintenance of constant or standard conditions. 



*The reader is referred to the January, 1912, number of the Teachers Coh 
lege Eecord for a detailed study of the ''Separate*' and ''Together" methods 
of teaching homonyms. Here there is a splendid illustration of a well-organized 
and a weU-condueted control experiment. The Teachers College Eecord for 
September, 1913, has another good example of a control experiment on the ques- 
tion of "Formal English Grammar as a Discipline." 
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Moreover, when the number of pupils is large, the handling of the 
statistical work becomes very laborious. Accordingly, more trust- 
worthy results may often be secured by the repetition of the experi- 
ment in other school systems under standardized conditions. 

The groups should be equal in ability because groups having 
low initial scores usually make large numerical gains with less ex- 
penditure of effort than do groups having high initial scores. When 
equal gains are expressed as percentages they seem much greater 
when based on low initial scores than when based on high initial 
scores. Percentage comparisons based upon unequal initial scores 
are thus very deceptive. Suppose that one fifth-grade group has an 
average initial speed of 50 letters a minute and the other of 75 let- 
ters a minute. An average gain of 10 letters a minute in each group 
appears to be an equal gain ; but when expressed in percentage form 
it is 20 percent for the slow group and 13^ percent for the rapid 
group. Thus the slow group has the higher percentage of gain. 
Tet anyone at all familiar with the teaching and learning processes 
in school knows that a gain of 10 letters in the rapid group is a much 
greater achievement than is a gain of 10 letters in the slow group. 
Hence the importance of having the groups of equal initial ability 
in order to estimate rightly the improvement. It is well that the 
sex distribution in the groups be equal and that the previous train- 
ing and home environment be as nearly equal as possible. Espe- 
cially is this equality important when small groups are used. If 
several classes, selected at random, are used in each group, varia- 
tions in conditions in the different classes will tend to neutralize 
each other. 

Third. In measuring the skill or ability of pupils, care must 
be taken that the tests measure the ability that is being studied, and 
that they are given under uniform conditions. No detail is too triv- 
ial to be considered. For example, a principal who was giving a 
test in arithmetic found a room in disorder because it was tempor- 
arily in charge of a substitute who was poor in discipline. Before 
giving the test he administered a, sharp reproof to the pupils. Al- 
ready in a bad attitude, they were humiliated by the reproof and 
failed to respond properly to the test. An equivalent one, given a 
few days later in the same room, secured far better results. Not only 
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must directions be followed exactly, and uniformity of procedure be 
maintained in all rooms, but also the proper attitude of pupils must 
be secured. Note in Dr Briggs' study on ''Formal Grammar" that 
he administered the test to both groups at the same time, thus in- 
suring uniformity. 

In almost every measurement of school achievement, both quan- 
tity and quality must be considered. Thus in handwriting we meas- 
ure both the rate and the quality of the writing. The customary 
directions for a handwriting test are: "Write as well as you can 
at your usual rate of speed the following sentence. Write the sen- 
tence again and again until I say 'Stop'." Suppose the teacher 
adds as a final suggestion, "Now, do your best, children"; the 
rate will then generally be reduced materially and the quality im- 
proved only slightly. In one room this added suggestion reduced 
the usual speed nearly fifty percent. From these comments it is 
evident that the results would be more trustworthy if the same per- 
son gave both the initial and final tests. In measuring school 
achievements, group measurements are usually taken, since forty 
pupils can be tested in a group in about one-fortieth of the time 
required to test each pupil individually. In some cases, as in oral 
reading, individual tests are necessary. Usually the amount of 
time required to give individual tests limits such tests to a very 
small number of pupils. 

In testing groups the time-limit method is generally used ; that 
is, rate or speed is measured by the amount of work done in a given 
time. In such tests, absolute uniformity of time is essential. For 
keeping time, a stop-watch is desirable, or at least a watch with a 
second hand. 

When individuals are tested, the work-limit method may be 
used. According to this method each pupil is given the same amount 
of work and his performance is measured by the time required to 
do it. Individual testing by the work-limit method is doubtless 
preferable to group testing by the time-limit method, but it is sel- 
dom practicable in ordinary classroom work. 

Fourth. The preceding paragraphs indicate the wisdom of the 
directions with regard to teachers. Unless teachers are open-minded, 
they will vitiate results. A teacher who feels that she must prove 
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that the method or book that she is using is superior to the other 
method or book will unconsciously destroy uniformity of conditi(ms. 
Unless teachers have a scientific attitude, they will fail to appre- 
ciate the value of many of the requirements in the experiment 
and are likely to feel that a failure to get highly satisfactory re- 
sults is a reflection upon them rather than upon the method. To 
maintain their own reputations as teachers, they must make the 
method successful. In order to do this they prevent the standard- 
izing of conditions. Unless teachers follow directions condusions 
will be worthless. 

Fifth. In addition to the detailed instructions in the hands 
of the teachers, conferences with them are also desirable. 

Sixth. As far as possible, all factors except the one under 
consideration should be kept uniform or standardized for all 
groups. For example, in the suggested study on ''Time Distribu- 
tion in Teaching Handwriting," no home study or practice on 
handwriting outside of school should be allowed, for such practice 
cannot be made uniform. No attention should be given to hand- 
writing in other subjects, otherwise varying factors will be intro- 
duced; all practice in and teaching of handwriting should be done 
during the sixty minute a week. All other work should be as 
nearly identical as possible. In the period between the initial and 
final testing, the quality of the teaching of the different groups 
should be, as nearly as possible, the same. It is difScult to select 
teachers of equal ability ; but by alternating them, or by repeating 
the entire experiment with similar alternation, the desired result 
may be secured. Sometimes the same teacher may instruct the sev- 
eral groups at different times. 

Seventh. The amount of time required for a control experi- 
ment varies with the nature of the experiment A few weeks may 
be suiBScient to show differences in improvement in spelling or 
handwriting. Several months, a year, or even more, may be needed 
to permit a fair estimate of the value of two methods in reading, 
or the value of kindergarten work. 

Eighth. The same care in measuring the ability of pupils at 
the end of the experiment must be used as was used at the begin- 
ning. The final test must be carefully chosen and must be of the 
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same difScalty as the initial test. The opportunity for each group 
to prepare for this final test should be absolutely equivalent except 
as to the one factor under survey. 

In a general study of the school achievements in a system, it 
is esisy to be deceived by two measures taken at different times. 
Suppose, for example, that you test pupils in spelling in October, 
using words from the Ayres' Scale. Suppose also that the teachers 
of your school have not had access to the Ayres' Scale prior to 
this time, but that after the test each teacher has a copy of it and 
drills on the words. Even though at the dose of the experimental 
period you do not use the same words as in the first test, but select 
from the Ayres' Scale other words of equal diflSculty, it is probable 
that your children will have apparently made great gain. You will 
not, however, have measured the real gain in spelling ability, since 
the pupils have been specially prepared for the second test. 

Ninth. The scoring of results must be absolutely uniform 
and the tabulations made in the same way. The greatest uniformity 
is secured by having the same person do all the scoring and tabu- 
lating. If more than one person participates in this work, specific 
directions must be given to insure uniformity of work. The anal- 
ysis and the correct interpretation of the gains and losses in a con- 
trol experiment are the most important parts of the work. The 
value of a method or of a given material is measured by the gain 
which results from its use. The method of computing this gain 
will depend somewhat upon the character of the factor that is being 
studied. In general, in measuring school achievements, the median, 
as a group measure, has the advantage over other measure^. It is 
easily and quickly computed and is not unduly affected by extreme 
scores. These extreme scores are always under suspicion. Further- 
more, especially high or especially low individual scores have little 
scientific value in determining, let us say, the efficiency of a method 
of teaching, since what is done by the unusual pupil does not meas- 
ure the value of the method for the great mass of pupils. Very high 
scores or very low scores affect the average much more than they 
do the median. The median, moreover, is likely to represent more 
closely the central tendency. It is often desirable to compute from 
the medians the percentage of gain or loss. When, however, the 
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percentage of gain or loss for each pupH is reported, the figures are 
misleading, unless the bases (t. e., the initial scores) on which the 
percentages are computed are equal. Besides medians and per- 
centages, the distribution of the scores (the frequency of eadi 
score) must receive careful consideration. The amount and pe^ 
centage of gain or loss for all pupils having the same initial score 
are valid %ures. The measure of the variability of the gains ii 
likewise important.* 

Tenth. After every reasonable effort has been made to keq) 
the factors uniform during the experiment, varying factors will 
often enter. These must always have consideration and their prob- 
able effects must be estimated. 

Eleventh. A single experiment, even when carefully con- 
ducted, is often not conclusive. In the report on the 'separate' and 
'together' methods of teaching homonyms, to which reference wm 
made above, note how guarded Dr. Pearson is in his statements. 
So far as his experiment is concerned, certain things are trae. 
Another experiment might show different results. 

Twelfth. When any conclusion of educational value has been 
reached by a single experiment, it should always be possible to ver- 
ify the result by repeating the experiment at another time or in 
another school under the same standardized conditions. This can 
be done only when a careful record has been kept of the plan of 
procedure and of the important controlling factors in the experi- 
ment. 

Uses of Control Experiments 

Some of the uses of control experiments have been suggested 
in the preceding discussion. While these uses are various, the fol- 
lowing may be particularly mentioned : 

a. To determine the relative value of two methods of teach- 
ing. 

b. To determine the relative value of two books or two kinds 
of drill material. 

c. To determine the best distribution of a given teaching time. 

Tor statistical methods see Thorndike 's Introduction to MentaX and Social 
Measwrements, Science Press, New York; Whipple's Manual of Mental and 
Physical Tests, Warwick and York, Baltimore, and Bugg's Statistical Methods 
Applied to Education, Houghton and Mifflin and Company. 
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d. To determine the amount of time needed to secure optimal 
results in a given subject. 

e. To determine the relative value of different organizations 
of subject matter. 

f . To determine the size of classes that will secure optimal 
results. 

g. To compare two types of school organization. 

Possibly these last two are too complicated to handle as an 
ordinary control experiment, but the principles of a control ex- 
periment should be applied. 

A control experiment is simple, but requires a scientific atti- 
tude and the constant use of good judgment and common sense. 
Many experiments of great promise have been rendered valueless 
by the neglect of one or two minor details. It will be a great boon to 
education when the various experiments that are being made in its 
field are placed under sufficiently controlled conditions to render 
the conclusions of scientific value. 

Large Problems 

In addition to the simpler problems suggested above, there are 
many others which are too comprehensive for any school district or 
even for any state to solve alone, and which must, therefore, be 
solved, if at all, by the cooperation of many agencies. Investiga- 
tions concerning types of school organization, length of sessions, 
sizes of classes, evening schools, recreation in and outside of school, 
vocational education and guidance, training of teachers, etc., are 
of too general a character to be satisfactorily made by a single 
agency. Various organizations are working on certain of these 
problems. Among them are the following: 

A. The National Society for the Study of Education. 

B. The National Education Association. 

C. The National Association of Directors of Educational Re- 
search. 

D. The American Association for the Advancement of Science. 

E. Various national organizations for teachers and workers 
in a number of fields. 
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F. Departments of education in universities and normal 
schools. (Some of these institutions have organized cooperatm 
bureaus as described in another chapter of this Yearbook.) 

G. State departments, some of which have cooperative ba- 
reaus similar to those in universities and normal schools. 

H. Educational Foundations. 

I. United States Bureau of Education. 

The United States Bureau of Education should have a Division 
of Educational Standards and Measurements. This bureau should 
be in charge of a thoroughly trained scientific student of educatioiit 
seasoned by practical and successful school experience, and shonld 
become a national clearing house for educational experiment. Sev- 
eral lines of work are open to such a bureau. 

First Testing of Methods. Two methods of teaching could be 
tried in a score or more of rooms in each of one hundred citieB. 
The United States Division of Standards and Measurements coold 
prepare outlines of experiments, provide both the initial and final 
tests, compile and analyze data from these one hundred cities and 
deduce conclusions that would have general value in educational 
work. The United States Bureau of Education would thus develop 
an influence in the field of education similar to that exerted by 
the Department of Agriculture in its sphere. Bulletins of the 
United States Bureau of Education would then be read and studied 
by progressive teachers and school administrators as the Agricul- 
tural Bulletins are now read by leaders in agriculture. Such work 
would enable every community to profit by the experience of other 
communities by adopting the really successful plans and avoiding 
or discarding those found to be unsuccessful. Under present con- 
ditions, however, although a given method may prove unsuccessful 
in a score of communities this year, another group of communities 
may try the same method next year, not knowing that it has al- 
ready failed or been discarded. Thus an unsuccessful method, if 
well-advertised, may gain admittance into many school systems only 
to be cast into the educational ** junk pile'* in time. 

Second. Testing drill material, books, and school appliances. 

Third. Cbnducting at various points in the United States edu- 
cational experiment stations, and making preliminary tests of cer- 
tain methods before extending their use to other localities. If the 
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vertical BytStem of handwriting had been tested out for a few years 
in a large commercial center, its shortcomings would have been 
discovered, and it probably would not have spread over the country. 

Fourth. Investigating many of the large problems of school 
administration that can be settled only by nation-wide study. These 
studies should be impartial and should not be conducted by en- 
thusiastic advocates of the scheme to be studied. This caution is 
submitted because even the United States Bureau is thought to have 
sometimes fallen under the influence of emotionalists and educa- 
tional promoters. The value of the Gary system, as referred to 
above, is a problem of national importance. The same ^Bureau 
of Education should be able to make a survey of the Gary Schools 
in operation in various places, and to secure accurate data as to the 
results that are being obtained. In the course of ten or twelve 
years, the country could know the facts with regard to this organiza- 
tion. Kansas City and several southern cities have a seven-year 
course of study in the elementary schools. If it is possible to cover 
the course satisfactorily in seven instead of eight years, the entire 
educational world should be made aware of this fact by an im- 
partial study of the work of these seven-year systems furnished by 
the United States Bureau of Education. The movement to estab- 
lish junior high schools is well under way. The value of this type 
of organization should be established, and no agency could do so 
better than the United States Bureau of Education. 

While, therefore, there are many problems, both large and small 
which await solution, the value of the solution of many of them, it 
is urged, would be greatly enhanced if it were made from an au- 
thoritative, impersonal, and national point of view. 
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percentage of gain or loss for each pupU is reported, the fig:are8 are 
misleading, unless the bases (t. e,, the initial scores) on which the 
percentages are computed are equal. Besides medians and per- 
centages, the distribution of the scores (the frequency of each 
score) must receive careful consideration. The amount and per- 
centage of gain or loss for all pupils having the same initial score 
are valid figures. The measure of the variability of the gains is 
likewise important.* 

Tenth. After every reasonable effort has been made to keep 
the factors uniform during the experiment, varying factors will 
often enter. These must always have consideration and their prob- 
able effects must be estimated. 

Eleventh. A single experiment, even when carefully con- 
ducted, is often not conclusive. In the report on the 'separate' and 
'together' methods of teaching homonyms, to which reference was 
made above, note how guarded Dr. Pearson is in his statements. 
So far as his experiment is concerned, certain things are true. 
Another experiment might show different results. 

Twelfth. When any conclusion of educational value has been 
reached by a single experiment, it should always be possible to ver- 
ify the result by repeating the experiment at another time or in 
another school under the same standardized conditions. This can 
be done only when a careful record has been kept of the plan of 
procedure and of the important controlling factors in the experi- 
ment. 

Uses of Control Experiments 

Some of the uses of control experiments have been suggested 
in the preceding discussion. While these uses are various, the fol- 
lowing may be particularly mentioned : 

a. To determine the relative value of two methods of teach- 
ing. 

b. To determine the relative value of two books or two kinds 
of drill material. 

c. To determine the best distribution of a given teaching time. 

Tor statistical methods see Thorndike's Introduction to Mental <tnd Social 
Measv/rements, Science Press, New York; Whipple's Manual of Mental and 
Physical Tests, Warwick and York, Baltimore, and Bugg's Statistical Methods 
Applied to Education, Houghton and Mifflin and Company. 
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d. To determine the amount of time needed to secure optimal 
results in a given subject. 

e. To determine the relative value of different organizations 
of subject matter. 

f . To determine the size of classes that will secure optimal 
results. 

g. To compare two types of school organization. 

Possibly these last two are too complicated to handle as an 
ordinary control experiment, but the principles of a control ex- 
periment should be applied. 

A control experiment is simple, but requires a scientific atti- 
tude and the constant use of good judgment and common sense. 
Many experiments of great promise have been rendered valueless 
by the neglect of one or two minor details. It will be a great boon to 
education when the various experiments that are being made in its 
field are placed under sufficiently controlled conditions to render 
the conclusions of scientific value. 

Large Problems 

In addition to the simpler problems suggested above, there are 
many others which are too comprehensive for any school district or 
even for any state to solve alone, and which must, therefore, be 
solved, if at all, by the cooperation of many agencies. Investiga- 
tions concerning types of school organization, length of sessions, 
sizes of classes, evening schools, recreation in and outside of school, 
vocational education and guidance, training of teachers, etc., are 
of too general a character to be satisfactorily made by a single 
agency. Various organizations are working on certain of these 
problems. Among them are the following : 

A. The National Society for the Study of Education. 

B. The National Education Association. 

C. The National Association of Directors of Educational Re- 
search. 

D. The American Association for the Advancement of Science. 

E. Various national organizations for teachers and workers 
in a number of fields. 
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F. Departments of education in universities and normal 
schools. (Some of these institutions have organized cooperative 
bureaus as described in another chapter of this Yearbook.) 

G. State departments, some of which have cooperative bu- 
reaus similar to those in universities and normal schools. 

H. Educational Foundations. 

I. United States Bureau of Education. 

The United States Bureau of Education should have a Division 
of Educational Standards and Measurements. This bureau should 
be in charge of a thoroughly trained scientific student of education, 
seasoned by practical and successful school experience, and should 
become a national clearing house for educational experiment. Sev- 
eral lines of work are open to such a bureau. 

First Testing of Methods. Two methods of teaching could be 
tried in a score or more of rooms in each of one hundred cities. 
The United States Division of Standards and Measurements could 
prepare outlines of experiments, provide both the initial and final 
tests, compile and analyze data from these one hundred cities and 
deduce conclusions that would have general value in educational 
work. The United States Bureau of Education would thus develop 
an influence in the field of education similar to that exerted by 
the Department of Agriculture in its sphere. Bulletins of the 
United States Bureau of Education would then be read and studied 
by progressive teachers and school administrators as the Agricul- 
tural Bulletins are now read by leaders in agriculture. Such work 
would enable every community to profit by the experience of other 
communities by adopting the really successful plans and avoiding 
or discarding those found to be unsuccessful. Under present con- 
ditions, however, although a given method may prove unsuccessful 
in a score of communities this year, another group of communities 
may try the same method next year, not knowing that it has al- 
ready failed or been discarded. Thus an unsuccessful method, if 
well-advertised, may gain admittance into many school systems only 
to be cast into the educational ''junk pile'' in time. 

Second. Testing drill material, books, and school appliances. 

Third. Oonducting at various points in the United States edu- 
cational experiment stations, and making preliminary tests of cer- 
tain methods before extending their use to other localities. If the 
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Tertical system of handwriting had been tested out for a few years 
in a large commercial center, its shortcomings would have been 
discovered, and it probably would not have spread over the country. 

Fourth. Investigating many of the large problems of school 
administration that can be settled only by nation-wide study. These 
studies should be impartial and should not be conducted by en- 
thusiastic advocates of the scheme to be studied. This caution is 
submitted because even the United States Bureau is thought to have 
sometimes fallen under the influence of emotionalists and educa- 
tional promoters. The value of the Gary system, as referred to 
above, is a problem of national importance. The same 'Bureau 
of Education should be able to make a survey of the Gary Schools 
in operation in various places, and to secure accurate data as to the 
results that are being obtained. In the course of ten or twelve 
years, the country could know the facts with regard to this organiza- 
tion. Kansas City and several southern cities have a seven-year 
course of study in the elementary schools. If it is possible to cover 
the course satisfactorily in seven instead of eight years, the entire 
educational world should be made aware of this fact by an im- 
partial study of the work of these seven-year systems furnished by 
the United States Bureau of Education. The movement to estab- 
lish junior high schools is well under way. The value of this type 
of organization should be established, and no agency could do so 
better than the United States Bureau of Education. 

While, therefore, there are many problems, both large and small 
which await solution, the value of the solution of many of them, it 
is urged, would be greatly enhanced if it were made from an au- 
thoritative, impersonal, and national point of view. 



CHAPTER Xn 

A LOOK FORWARD 



CHABLES H. JUDD 
Director, School of Education, University of Cliieago. 



A paper dealing with the future can justify itself in a scientific 
volume of this kind only when it bases itself on an analysis of 
present conditions and aims to develop as a result of such an 
analysis suggestions for improvements and enlargements of the 
movement under discussion. The reader is warned, therefore, at 
the beginning that this paper looks backward as well as forward, 
in order that justification may be furnished for some of the plans 
urged as desirable for the future. 

One fact which is evident to every student of school problems 
is that the movement toward the development of measurements is 
both promoted and seriously encumbered by a vague popular de- 
mand. Parents have heard that there are methods of finding out 
whether their children can spell or add or read satisfactorily, and 
immediately a clamor arises for a measurement of the local school. 
The demand is likely to be especially keen if there is some parent 
in the community who does not like the superintendent or the prin- 
cipal. Such a parent never for a moment believes that responsi- 
bility for unsatisfactory school results is to be traced to the native^ 
limitations in the ability of his child or to the home atmosphere 
in which the child grows up. Such a parent is quite certain that 
measurement will detect at some point a lack of perfection, and 
then he knows that his dislike for the school officer will have the 
sanction of science. 

It is little wonder that school superintendents have often been 
afraid to have their schools measured. Especially hazardous is it 
to have the schools measured in many respects in a single survey. 
The number of imperfections sure to be revealed in a general survey 
is appalling. One has the same dread of going to a dentist to have 
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his teeth examined, knowing well that one's teeth are sure to 'go 
to pieces' under the keen scrutiny of the expert. The case would 
be still worse for most of us if we were obliged to submit the im- 
perfections of our features to the relentless analysis of an expert 
in physiognomy. 

In the presence of a popular demand for the revelation of im- 
perfections and the absolute certainty that imperfections exist, it 
is not difficult to understand why there should be a tendency on 
the part of many school officers to combat the movement toward 
wide-spread meararement. 

The future is sure to develop a new and more wholesome atti- 
tude on the part both of the public and of school officers. Indeed, 
the measurements which have been made up to this time have more 
than justified their cost in effort and money, beca\ise they have dis- 
pelled forever the idea that schools should produce a uniform 
product or one that is perfect in its attainments. We all under- 
stand now in definite scientific terms that children are different 
from one another, that the lower grades progress slowly toward 
satisfactory results, that movement within the school is purchased 
at great expenditure of labor on the part of all concerned, and that 
the best we can hope for is improvement — ^not absolute achievement 
of ideals. 

With the theoretical ideal of perfection overthrown, there is 
now an opportunity to set up rational demands. We can venture 
to tell parents with assurance that their children in the fifth grade 
are as good as the average if they misspell fifty percent of a certain 
list of words. We know this just as well as we know that a certain 
automobile engine cannot draw a ton of weight up a certain hill. 
No one has a right to make an unscientific demand of the automobile 
or of the school. 

As soon as school officers recognize the fact that measurements 
define for them just how much may reasonably be demanded, they 
will be unafraid of measurements. Indeed, they will learn the ad- 
ministrative lesson that it is better to know for purposes of ordinary 
routine what ought to be demanded than merely to guess at condi- 
tions. The writer once heard a business man put the matter very 
clearly. He was looking at some diagrams that showed the results 
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the work of the class and of the individual. Those who complain 
that the teacher does not have time to make measurements miss the 
point entirely. The teacher often wastes time and eflfort under exist- 
ing conditions because of ignorance of the direct point where appli- 
cation of teaching energy would be most eflfective. The right kind of 
classroom measurements, as suggested in the examples cited above, 
do not interrupt class routine at all, but contribute exact methods 
of procedure M the same time that they reveal to the teacher where 
the class stands. 

A conception such as that given in the last paragraphs will also 
dear up another diflSculty which teachers sometimes point out. 
They complain that the volume of experimentation is so great that 
the class exercises are disorganized and disrupted. The advice 
which ought to be given to a teacher who makes this complaint is 
that one kind of class exercise should be transformed at a time. 
Methods should be built up in each subject which serve both the 
purposes of measurement and of teaching. This can be done, but 
it requires readjustment and planning. 

The second prophecy which one may venture is, accordingly, 
that measurement will more and more take up details and will be- 
come a common instrument in the hands of the classroom teacher. 

One objection which has been urged again and again against 
measurement is that it deals only with the formal and mechanical 
aspects of education. This objection has nowhere been more defi- 
nitely stated than by Superintendent Horn in his Supplementary 
Survey of Portland Public Schools where he writes as follows : 

**It should furthermore be kept in mind that there are many 
things about a school system which can never be definitely measured 
or stated with mathematical accuracy. Just where the line is to 
be drawn between the measurable and the non-measurable elements 
that enter into a school is a matter concerning which there is much 
difference of opinion. In other words, the element of opinion enters 
to some extent even into the matter of the possibility of measure- 
ment. 

**Por instance, it is an undoubted fact that any man can go 
into a city and count the school houses or the number of the des^. 
Any man can find out the number of teachers employed. Any man 
can count for himself the number of pupils present in a given room. 
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''It takes no particular ability to enable an inquirer to find 
out just how much money is being spent. If the schools spent nine 
hundred thousand dollars in one year and a million dollars the 
next year, any one can deduce the fact that they spent one hundred 
thousand dollars more the second year than the first year. 

**0n the other hand, after a comparatively few such facts have 
been definitely ascertained, we come to subjects that cannot be 
measured in mathematical terms, and concerning which there are no 
definite standards. In this realm ideals are not always definitely 
established and opinions are almost certain to vary widely. 

''For instance, if you take two classes, one across the hall from 
the other, who can decide in which of the classes the higher 
ideal of truthfulness or honesty prevails? Who can say which 
teacher is more successful in making the children self-reliant, and to 
what extent? We all know that in such a case, if the two teachers 
are both fairly good, many pupils and patrons will consider one 
the better teacher, while many others will consider the other the 
better. Especially will this be true with reference to such matters 
as the teaching of honesty, industry and self-reliance. Incidentally, 
these very things are* recognized as being among the most important 
of all the elements entering into the question of the teacher's effi- 
ciency. A school that turns out manly, honorable, self-reliant boys 
and womanly, efficient girls is likely to be at least a fairly good 
school, no matter what it may do otherwise. A school that fails 
to turn out such pupils can hardly be considered a good one, no 
matter what it may do for its pupils in the way of reading, or 
writing, or arithmetic. And yet these very things, which may de- 
cide between the success or failure of the school, are matters which 
it is almost impossible to estimate accurately, and concerning which 
there may be a wide amount of honest diflference of opinion."^ 

The success of the measurement movement depends on its abil- 
ity to meet this type of objection. 

Some of us might be entirely willing to rest the case after ask- 
ing whether in practical school life anyone ever saw a teacher thor- 
oughly competent in teaching ideals but neglectful of reading and 
arithmetic. The fact is that the conscientious teacher always gives 
attention to both, and the successful teacher is able without omitting 
one to cultivate the other. The theoretical possibility of thinking 
of the two results separately has little significance in dealing with 
real teachers and real scho<)ls. (Jood reading is a school virtue, and 



*P. W. Horn, Beport of Supplementary Survey of Portland PuhHc SchooU, 
pp. 6-7. April, 1917. 
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when one has measored good reading, he has measured more than 
the trivial or formal side of education. 

The hope of the measurement movement is, however, to do more 
than to deny the validity of such criticism as Mr. Horn makes. 
There is to be progress in covering more fully the details of school 
work. Today we know how to measure many aspects of teaching. 
The reason for our early attack on the formal dements is that these 
yield readily to analysis and thus to theoretical isolation and exact 
treatment What we need to do is to carry our analysis further 
and then new measurements will become easier. 

A few years ago reading tests seemed impossible. Today we 
have mastered the distinction between oral and silent reading. We 
have good methods of measuring some of the more common types 
of deficiency and we know the rate of progress which is normal in 
the more obvious phases of interpretation. The progress in this 
field within a single year is so large that there is nothing but opti- 
mism in the minds of those carrying on the work. What we need 
is more interest on the part of practical workers and more experi- 
mentation with methods. 

Those of us who have watched the progress of measurement 
will recall distinctly that the earliest critics of the movement were 
more emphatic than the present-day critics in declaring that school 
results could not be measured. This type of criticism was the one 
with which Mr. Rice's opponents thought they had forever elimi- 
nated him and his type of work from the schools. Steadily the 
range of measurements has broadened. Steadily the productivity 
of the movement has increased. It is not for the advocate of the 
movement to prophesy its limits ; it is perfectly safe for him, how- 
ever, to assure all the world that the end is not yet in sight. So 
long as advantage comes from the pushing forward of this move- 
ment, so long as ingenuity is at hand to devise new modes of pro- 
cedure, the answer to the objection that measurement is limited to 
a few trivial aspects of teaching is steadily becoming more cogent 

This hopeful conclusion is fully supported by one fact which 
serves at the same time to reveal one of the most important ad- 
vantages of measurement, namely, the fact that with the develop- 
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ment of measurement there is coming into education a greater gen- 
eral clearness and definiteness of purpose. 

An example will show what is meant. In the high school of 
Kansas City, Kans., there is a system of telling the students defi- 
nitely and in detail what they must ^o if they want to secure the 
higher grades, A or £, in a given course. The very fact that students 
in that school have all along been given A, B, and C shows that 
measuring of all sorts of intellectual and moral qualities has been 
going on. The interesting fact is that in most places the measuring 
is vague and often unsatisfactory, because no one has taken the 
pains to define what is wanted. Students know that teachers are 
often arbitrary, and, be it confessed, teachers also know that they 
are vague. The system referred to above removes some of the 
ambiguities. It improves the measuring system, making it definite 
and exact, because it analyzes and defines the elements of work 
demanded. 

Suppose that the teachers of a school should concentrate for 
half a year on cultivating the power of concentration of attention. 
Is there any doubt that much new information would be gained 
about concentration and that there would be more accurate methods 
of determining its degree t Measurement will be extended in the 
future. The reasons why one can be so sure about this statement 
are to be found in the history of the past few years. 

The third prophecy that can be made is, therefore, that the 
scope of measurement will be widened until it is suflSciently in- 
clusive to satisfy even the most exacting critic. Concentration of 
attention, ability to attack various kinds of problems, clearness of 
insight, power of inference in various fidds will be measured. The 
demand again is for workers who will give themselves the training in 
analysis and take the pains in collecting material that is necessary 
to bring about this consummation. 

It may be unscientific to prophesy about the remoter social 
consequences of such a movement as we are discussing, but certain 
final observations may serve to show why the advocates of measure- 
ment in education are unlimitedly optimistic. The time is rapidly 
passing when the reformer can praise his new devices and offer as 
the reason for his satisfaction, his personal observation of what was 
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accomplished. The superintendent who reports to his board on 
the basis of mere opinion is rapidly becoming a relic of an earlier 
and unscientific age. There are indications that even the principals 
of elementary schools are beginning to study their schools by exact 
methods and are basing their supervision on the results of their 
measurements of what teachers accomplish. A social change of 
this kind is adequate justification for any movement and a sufficient 
guarantee for its continuance. 



CHAPTER Xm 

EDNA BBYNEB 
BuBsell Sage Foundation, New York City 

A SELECTED BIBLIOGRAPHY OP CERTAIN PHASES OP 

EDUCATIONAL MEASUREMENTS 



These magazine articles, bulletins, reports, books and surveys 
are grouped on the basis of similarity of general content and are 
arranged alphabetically within each division according to authors. 

Divisions 

A. Theory of Educational Measurement and Developmeiit of 
the Movement. 

B. Tests and Scales in Various School Subjects. 

C. General Reports on the Use of Tests and Scales in Schools 

D. Lists of Tests and Scales 

E. Correlations between Abilities 
P. Teachers' Measurement 

G. Articles about Surveys and Lists of Surveys 

H. City Surveys 

I. State, County and other surveys 

Abbreviations 

AmEd: American Education 
AmJPs: American Journal of Psychology 
AmScBdJ: American School Board Journal 
BrJPs: British Journal of Psychology 
Ed: Education 

EdAdm: Educational Administration and Supervision 
EdPsMon: Educational Psychology Monographs 
ElScJ: Elementary School Journal 
ElScTch: Elementary School Teacher 
EngJ: English Journal 

IndianaConfMes: Annual Conference on Educational Meas- 
urements, Indiana University 

IndianaUnSd: Indiana University Studies 
JEdPs: Journal of Educational Psychology 
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JEPd: Journal of Experimental Pedagogy 

KansasBurMes: Studies by the Bureau of Educational Meas- 
urement Kansas State Normal School 

NaEdAsBu: National Education Association Bulletin 

PdSe: Pedagogical Seminary 

ProcDepSupt: Proceedings Department Superintendence Na- 
tional Education Association 

PopSciM: Popular Science Monthly 

ProcNaEdAs: Proceedings National Education Afisociation 

PsCl: Psychological Clinic 

ScHomeEd: School and Home Education 

Set: Science 

ScR: School Review 

ScRMon: School Review Monographs 

ScSciMat: School Science and Mathematics 

ScSac: School & Society 

Teh: Teaching 

TchCollConEd: Teachers College Contribution to Education 

TchCoURec: Teachers College Record 

UnlowaExtnBu: University of Iowa Extension Bulletin 

USBurEdBu: United State Bureau of Educational Bulletins 

TbNaSoc: Yearbook of the National Society for the Study of 
Education 
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10. Ballou, F. W. Training normal-sdiool seniors in educational moMnnt- 

ment. ScSoc, 5: Jan. 20, 1917, 61-70. 
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NATIONAL ASSOCIATION 

OF 

DIBEGTOBS OF EDUCATIONAL BESEABCH 

Constitution 

Abtioix I 

Name. — ^The name of this organization shall be the National Aasodatioa 
of Direetora of Educational Besearch. 

Abticlb n 

Ohjeoi, — The object of the Aasociatioin shall be: (1) the formation of 
independent departments of educational research in all systems of public in- 
struction, and (2) the promotion of the practical use of educational measure- 
ments in all educational research having for its object the improvement of the 
efficiency of the educational administration, supervision or teaching. 

Abtiolb in 

M&mberBhip, — Skction 1. In general, membership in the Association shall 
be restricted to those who are actively and mainly engaged in research ^ork 
having for its direct purpose the evaluation of the products of educational 
training or the improvement of the efficiency of educational teaching, supers 
vision or administration. 

Sbo. 2. Membership in the Association may be either regular or associate. 
Begular members shall have any and all of the rights and privileges of the 
Association, including the right to vote, to hold office, and to appear upon any 
formal or informal program of the Association. Associate members are not 
eligible for office, have no vote and may not appear in any formal program of 
the Association, or otherwise represent Uie Association in public meetings, with- 
out special invitation of the Executive Committee; but they are to receive all 
bulletins of the Association, to be notified of all meetings or other activities 
and no distinction is to be made in any informal meeting or program between 
them and regular members. 

Sec. 3. Any person holding the position of Director of, or supervising, a 
Department of Educational Besearch in an educational institution, or any im- 
mediate assistant of such director, shall be eligible for full membership. 

Sxo. 4. Any person actively engaged in research work in education, but 
holding some educational position other than in a department of research shall 
be eligible for associate membership. 

Sec. 5. The Executive Committee, through the Secretary, shall, if neces- 
sary, ask all applicants for membersMp to state their positions, duties and 
past achievements in measurement work, and decision as to eligibility shall 
be made by the Executive Committee, in all cases where the applicant holds 
two or more positions, one of which has to do with educational research, the 
decision of the Executive Committee shall be made in accordance with the in- 
tent of the qualifications for membership as outlined above. Begular members 
who have not contributed to the bulletins of the Association during the year 
shall automatically become associate members at the annual meeting next fol- 
lowing. 
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AMinCLE TV 

Duei amd AMteMammU. — ^There dudl be no regular anniial doeiL Th/t ex- 
penses ineidentol to earrying on the wMk of tlie Assoeiation shall be met bj 
an assesment voted at taA regnlar anneal meeting. 

ABnci.B y 

Ofieen. — ^ne offieers shall eonsist of a presidenty a Tiee-presidenty and a 
seeretarj-treasnrer. These offieers shall be eleeted at the regular anniial m ee t 
ing of the Association. Their dnties shall be those nsoall j performed by watk 
offieenL 

AxncELi YI 

Exeemiipe Co m w mi iee. — ^There diall be one ezeeatiTe eommittee of fire mem- 
bers eonsis ti ng of the offieers and the two preeeding presidflnts whose dntj 
sfaiU be the eondnet of the basinesB of the Association between meetingSL 

Abxiglb vn 

Meetmgs. — ^The time and plaee of holding the annual meeting diall be 
determined b j a vote of the Association. Special meetings of the Association 
or of tiie ezecntiTe eommittee may be called by the presidenty and most be 
called by him whenever requested by a majority of tiie ezecatiye eommittee. 

AmoLiyni 

AwiendmenU, — Changes in this eonstitotion may be made at any annnal 
meeting of the AsBoeiati<m by the affirmative vote of two-thirds of the 
bers present. 
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Invitation 

Thfi AiMociation urf(es all persone profeesionally engaged in educational 
rMiearch having for ite purpose the improvement of the efficiency of school work, 
to join iho AMMOciation and lend the influence of their names and positions to 
the efforts of tho Association to stimulate the growth of the movement. 



ANNOUNCEMENT OF YEARBOOKS AND EXPLANATION 

OF MEMBERSHIP IN THE NATIONAL SOCTETY 

FOR THE STUDY OF EDUCATION 

The purpose of the National Society is to promote the investi- 
gation and discussion of educational questions. Anyone who is 
interested in receiving its publications may become a member. The 
Yearbooks are issued in several Parts each year and are discussed 
at the annual meeting, which is held in February at the same time 
and place as the meeting of the Department of Superintendence 
of the National Education Association. There are two types of 
membership, associate and active. Associate members pay $1.00 
annually and receive one copy of each Yearbook, Active members 
pay $2.00 annually, receive two copies of each Yearbook, and are 
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